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AN EXrKRIMKNTAL COAtPARISON OF THE 
SniDY-TKST AND TKST^TUDY METHODS 
IN SREI.LINC; 

AUTIIUR 1 OATES 
Tcachons C'oUege, Columbia Umvor&tly 

The present study is one of a scrioa of Invoatigations plaaucci to 
inquire Into the posBibiliUes of improving Inatruolinn In Rpolllng. 
InveaUgfttlona oocoplotl oa clUacrUliona for thr Docloraip at Tonoliora 
College hy Robert Thomiison, Ilerborl A. Carroll, Jamca E. Menden¬ 
hall, Claire T. Zyvo, Iim C. Karlorim*. and IV. It. Cnleman,' deal with 
closely related problcmH, and olliers will Im corn]>lolt!d shoflly, 

Tlic present invcslignthm is an inquiry poncnniing the gross 
efficiency of the two most widely used general mplliods: tho Pro-aludy 
or Study-teat inelhnd and iho Pre-test or IVal-sludy plan. In some 
measure, tha invealigaton provides dnin which suggpBt the iniicront 
hmltaliona and merits of the two rivol procedureK nnd whwh indicate 
possible imprcivemotiU in eueli. The atudy iiloo provides several clues 
for further rewareh for Ihe purpose of appraising inodificalionti of 
possible value. 

Tho liU*raluro nffords few expeniiieiilal comparisons of tho Pro- 
sLudy nnd the Pre-test luelhodH. Kwner's study* based upon ninc- 

‘ 'niompscm, It.: "The Effwnicw^ of .Motii'ni Mprlliiig Iiislnirlum,'* 'roncli- 
orft Colli'RO, Ckiluml'jji I'luvmKv, Coiilnbulioiis lo EUnnUioii, No 430, I'arrull, 
11. A. '•OencraUiRtiou uf Hnutit awl Ibill A CV,mipttmUvo Htwl> ^vlth 

Hpecml Hefpreiicp to Hpolliag," Tnirh^nt Columlua UiiiNurmtv, Coritnlm- 

tiona to ICdiipatioii, No. ‘KUI; Mnidralinll, J K . "Am Aiinl>HiHof.Sin.'ltioK Errorn,” 
IVacborfl College Ihircmi nj PiililiPBliirtiM, IIKIU; 25v^c, T.: ‘‘A t’oiupftmtivo 

Study of MethofU" (m preiw); Hurnmus, 1 t‘ *"Ihe IlnwM of {Jriii'rnluiHtioo 5u 
Spelling'' (in profinraUtmJ} ('olrfimn, \V. if * " 811010*11 of Hpullmg Voi'nlHilurii'-i' 
(ill prepnrnliun). 

*lTuUvIduftl Method M. tirewp Mntwid «i( 'I'enelmig Spulhug /''ourf/i Ymr 
Book of th Deportmonl of •S'»/KTi/ilfn»/rwfr, WnHhiiigloii. I). (‘, lllllO 

1 





methcwl in Gratify*! 11 and III, aad «iirJlnria^p tib<^ plan in 

Oradp& IV to VU 1 A Miidy by Wcso^ly,* jn*p4^ m Grtwl^^ 

VI, Vll, nnd VIII gavf no advanasj^'p So jdan„ Kd" 

acf^ Id & 8*ludy wmfiml to idnib-jpradip ptip?!* tfiTOnd. an^f^rding to Im 

methods of coinpuiints r*“ff»lK that wKil*’ mrihod jgawi 

belter Immediate rr^olia, the ndvanta^f m4 nppafent in lestii 
after an interval of ais months 


TiIK i^ffpr-TtfcST rSS?>fmAlW 

]''or Ibe Study-lrfel prcM^’duro womk «;ori(^ Mi'a'tl ^ far 

IhuTesit^ludy nieilioti. 'Itie uumbrr per sns'ek varied wish she gr»idi. 
Each week's afisignmeni wnj diviiSed tnlo fosir etjnaJ ()ne 

these short lisla wm i«tudJed on ^Cosday, T’lie^y, Wrdmffecky, and 
Thursday, respectively. Friday sra® devoted so a s«i«i on she week"® 
argument, foUawrd by review when Umo perKdssnl 

The method of inlroduelDg tbe worvla vt-m ^uMantiidiy as Mlow^: 


1. 'Hs# leaeluj-r pmtKWiftifHwl ihe Winr*! ehaih If ii'^,n t^f 

taora ayltahlei^ itwa^ «v|Uhw 

S. Tha ward aasi URf^d its *»»» oriwjr*' Iw w-iwa 

o^ked to une Itm ward in a 

8. The t^aekerwioiB iW wottS wn OwS-U'iiS<«*fd^|v«-<rSi5\Snns.a« jt 
>h Tlio pupiU looked at ihe wool aind «aid is. «ii 3 SshSt* h‘ c im gS««'{<‘h: 
selves 

S. The pupib lookiod at the ward iwnol tuisd shr ivt ihrn«4n''a'>’', llbaj 
pupila were enccniraRr’d to group Ike Ivii«>r4 !•> « 4 {oS,loi m ^htr^ 

0. Thi'y loobnl at UiQ word a^tn wbniea? thejrn S/y 

7. Baum na t5>. 

8. Pupils ck»w;d Uieir ©vch aod taid iHe IrttaT* sn U«<'it.wKrf t« n 

lOiUiucofi die tomc'lioradsed ono pupU lo do IhiialMid i%p r,>M| 

0. Pupib wrote the wort! m (hr) mikI lSi» bi S9,r'i4f4.< ^ 'ilx tt 
O^ltded by aylUidr^ wbenevfT f^uatiilo 

10, They eom^M\reil Uietr wrU-tt^n word with »W luwi ‘*5^ t«v,v| 

It, PupOa covered thrsir word, wniio ii ag'^ui and KOiWij^iijtf^S rt wjib t'»x rnj«»'i 

form. 

12. They nsp^ltsd (11) iinUi Uipy could write tW word iwnh’fi<! nnir 

I I, 

* Tlio BvoluAtion of Two Methods of Ttwclung KpeJhug P'yfitrenth } tmrhv^ii mj 
iht HotUnvil Societii of C^(^e Tetutht^s e^f Bdf>faSxsi% Tiji*iptw}i4 <ii fhif-iRTi 1 ‘i'p^i, 
1027. 

* Ellior, L. n,: TheT^Ufludy ci. the 8ludy>i«^ Mpthu^l in -Strt*lbflB 

Sehool R&iiev}, 1020, pp. d2{'-62d. 
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The above plan was modified in details to meet the pnrtloular 
needs of the difTerent groups, which varied from the dullest second- 
grade to the J)nghte8t eighth-grade clasaea. 

Near the end of the [ktIocI the pupila wert* given n teat of the words 
studied during the day. If n word was mlKsed by more than half Die 
drum, It was added to the list for the next clay. 

On Friday a tost of oil word* taught during the week waa con¬ 
ducted. Words frequently missed wore put Into a review list. Those 
proving to be particularly difficult were rotaught, if possible, during 
the following week. Others w'ere retained for n review period about a 
mondi later. 


Thk Test^tody Pljin 

The Test-study plan empbyod was in general outline the plan 
recommended by Horn* m 1019 and since ^videly used. The aobcdulo 
is ns follows: 

Afotuiay, —Tc«t tm nil words m the iww nwoanmrnt for thoi wcHjk. 

y’wWuj/.--Individiiftlri study the wurda mutml oji iho Moufisy tr^t. I’upds 
moking DO errors on thn Mmidny tost nro cxcum^I. 

lFcdn«4</ay.—Tc«t on new nod rcviuw words All pupils takt' Uus toHt 

T'Aursdny.—Htudy of wordn rninwl on WnlnorMlny ir^l. Pupih making no 
orrora am cxcu>nhI 

Friday —Teal on somw wortla a* iihwI qu WwliuisclRy for ftU pupiU. HUidy 
mif^l words iw far na Limp i>prmit4i 

Once a month a review tost waa given comprising tlio most clifTicolt 
words used during the preceding month. 

The Ksi'euimbntaIj Soiieoule 

The exporlnienl wna conducted during the period from t’obruary 
1 to June 30, 1928. The period was divided into two parts. Each 
period consisted approxmmlely of nine weeks for teaching and one 
week for testing. During the first period half of the classes used the 
Study-test method and half the Test-study. During the second 
period tlie methods were reversed. Thus, each pupil spout approxi¬ 
mately ton weeka wiUi one luolhod and ten with the other. This 
schemo makes two types of comparisons jiussiblo; (1) Iteaulls olilninocl 
from groups using tlie two dilTomnt. methods at tlio sumo Lime and wifli 

' Prinriplps of Mptlioil iii 'JVAriiina Kpplliiig iia DimivpiI from Mpii>ii(ilii’ Invi-ali- 
gfttionjK fiighU’cnUi YetirltonK nj thr NnUoml Sofidy fur Ihv t^lndy uf litluc<il\on, 
Part II 







obimowi frt»tn (R«f« rnnh^Ml ia iIk |rr*<wj m^5V S-^ wlni 

ih*»R oblainni iindrT ib^ ts%hft <« fif«it. 

ThR .‘‘I'WRTJV* 

Th^ *>rtKi»^y ft<4T3> «?) 

eU^fSii In Oradi?"* U VIU r-f PaWw' 7W„ UD4(ff 

Principal Fr^disrick V. (tmli^m Tlw*««ratsri of ran^rnlfrfwlSy ewjrwplHfl 

and usabli* in ntimpiiiiug »mw|<5 sr<*r»' a#^ foMoiir^. 

Fimt iwjwkI I'S» 1 psisf'ii 

jwia4 i'jS tfl-jjnKjwi 

TolsJ nuiabcf wT (r*jnipM«* ts^m^ ^23*? 

For Ibe c^qiiimlpnl Rmup aiudi«»w tthkh ii^cTr^jhiiK^d ih^ HitniM* 
tian of rccorda to bccuo;^ ^qiwiw»k*nl iMrarr-^ slti'p owml'wr wf cflBh 
plnlfi pupfFnecortb mB 2fNK). 

PHKUMrJ«ARt A3fO Tlfef^ 

Thu aami? Jlsil of word* irajuiwd fora prHirnmaijr aorj Huai u»»t 
The Usl coJM^ialiHl of fitly iiturtia ai ratid^mi ff«m) shf wi^nU U) b 
aludied by each claw during !ho i^n <«( rise* r"'sp rjm<"Oi Tb 

tesla were jid^en by ilic fatniFar cnlunm dirians^m Th^* fluw' 

t>cir of words correct was mutUpliod by two in f^rtven ^srnirt^s inie 
parcenloRcs eoni^cl. 

The IQ’b obtained by gnniii^iie^ing in sf^r ronsme wurk of ih» 
school were Recured from Ihe wbrnd rrfw»rcbs and iwrd in rftinpario!^ 
groups. Thai, iho (nlUal apeUing Won'S t<»r Uw rbts^a csnns^jwBiI 
very cloiwly in the Iniclllgenee rating of the ebms ni » givrn grad^ 
level is apparent in the data of Table I, li j?» alpai obvipuft ilmt, prub 
ably aa n reaidi of freciuent examlnaimns mih ibp Rrtnjp le^is 
IQ’s, beginning wUb (Jrnde HI, run iilgh li m lee!ir‘V»*tl, hrtwever, 
that the population of the sclitml as n whole is c)t«s»" l<» nvrrnKe >n 
lutUvo lutolloctual capaciiy. 

ItRsoLra 

CtWpdrison oj C{q»ma iritfim a fiirew J^ineo ibe pujnU iti 

tliesdhoal arc daj^d on the Imalaof InioHigence (<‘hIs, ti was miiMwibh* 
to leeum groups of unaoleeted pupils wiUun « given grade A selicdub 
was therefore adopted which would give n» nearly «s pw^ible iwe 
oquivftlont combitmUons of claagisg wiililii each grade. Tills wa« 
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Tablu I “C’oMPAiuMjNfl or (*tas»RN I'lnNa Sriifir*TKftT anu 'rKwr-rriDT 
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M 
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12(1 0 
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>11 2 
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08 1 

IlH 1 
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I.>2 II 
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70 1 
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('ll 1 

01 0 
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00 3 
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t7 

IJil 8 

/,i II 
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112 II 
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IIA I 

111 8 
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Th Jannml af Bilutaiiaml 

umially cIoup by combining th? imghic^l And dislb^sS m am 

group and Ihc middle cla!f»»*< in ihe other TIr p-kS remix's r^igofid 
to Iho Study-teat plan and lh« middle* (Sfouj®^ \o !!he Te^l-reuidy plan 
In one grade, the reverae in the nwtt. and n* on aUpmaloly, J>«;‘fnu|t 9 
In some ol Vbc ctaeR ibe wh^ine m cs'rt^^-in rW^^. 

The recordfl available for tlie fir»l exi^^nmeni art' ehown m Table 
X. In this inblo art* given for rarli grtnip ihe miinlsrr rtf p?jpiK the 
mean IQ. (he mean initial af^llins in r»*rreniaft*'' rorwl, Ibe 
mean final BpoUlng isotJh?, and the mean gain. The gain h rnemly 
the dlffercnco Iwlween the mean Iniiiai and mean firmi aenrt-)*- The 
laal line under each grade give*i the numlfcr of pufdb;, the mean IQ, 
initial and final acoma, and i^in Cor the pupila of Uiai giwie. Tim 
figures wore obtained not from UieprtNsr^dingela^'Wwiv^biU from tba 
Individual records of the pupilBin the gmiipis 

Slnoo a Btudy by Rrjbert S. Thomp««n’ revrnSr*! w difiieully 
In comparing gains of group® which differ In mitml tbe data in 

Table I are not readily inloriiretcd when the IniiiiU are unequid* 
Dr. Thompson found that, olhor things l^ing equal, puplbi obtninjng 
a lowlniUol score gain more, In terms of percentages of eaitecl arsdiingg, 
than those obtaining higher intUnl scotch He found that, In genemt, 
equal teaching and learning would pmducte cfpjal advance’s in ibe 
Interval between the Initial |>ereenlH^ eornerl and ono hundred imr- 
conlogc correct. Thus, ll one group advances, ssay, half «f the disiance 
from Initial score forty poreonioge lo one-hundred i^erceniage rnrreei 
OP to seventy poreenlago eorrect, another gmup with an (niiml wire 

of sbety Bhoiifd advance to 00 ^ or SO aa the uf i‘qual 

learning. Wlillc these relailwna givon by Tiiomtmm could apphed 
In Ihla ense, it was felt that where diflforenciM are a« pmnll Ihw 
appear to he the more lalMJrioua process of dfling the pupiU iluwii to 
groups equivalent in initial senrt*a would l»e iium* rediable. Table I 
is offorod for those who wiah to make compariNonH of ctmw'H by ulih^iug 
Thompson's data or other means, 

, Comparison oj Oaim s\latU by Groups of P^qmtoicul InUml Ahilifu ' 
Id Table 11 the results of both etudii^ are shown. In each vim* pupils 
were first arranged by grades. Then pupils following the Hiudy-mi 
plan wero matched in initial scores with pupds f«Ucjwiiig the T(n«i study 
plop* This usually resulLed in a smplus of iniiuil m^r%^ m tine gomp 

‘ Thompeon, li.: ''Tim ElT(H:U\^iies^of Modern Hjmilinjs lofslniiriMm " IVidi- 
era CoUogo, Columbia Univeralt)’ C^nlribution^ lo {^lucaimu. N’» am . 
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Comparison of MHhods in f^pdiing 

and low iieoiTS in the othpr, which had lo Ik* climinnterl. Tho piun 
pursued W!i« not an exact onevppr-onp matching, but one which gave 
the largest number oi ca'H^ wlLhmil appreciably disturbing the equiv¬ 
alence of the groutifl jn mean and 81) of Initial scores. Thus for 
example, one group might 1«* given three pupila with of thirty- 
nine, forty, forty-one res|M?ctlvdy an equivalent lo two aeore* of forty, 
when the cfToctK of this nmigriment could Ik* coimlerhalnneed. ('on- 
soquently, although the gmutM nit* sulistantialiy e<|uiva[ent, the 
numlier of pu|ii!w in the group are not nln’uys the wime 

The rcsulla reveiiled by Tabic II may be summarised by the sUile- 
ment llial in m far as cbtTerencea are indicated at all, the 8ludy-tost 
melhocl produces larger gains in (trade It and low CIrado III and tlic 
Teat-aludy plan yields git^nior gaina from high Grade III to the Gracio 
VIII inclusive. 

The advantages of theSludy-lesl plan in the second and lower third 
grades (t.e, first half of the third grade) are neither large nor, in terms 
of the Standard Mrror, highly reliable. Since the groups are evenly 
matched in initial spelling scores and since llie advantage m IQ’a, it 
any, is enjoyed by the Teal-study groups, and aiuce the same teachers 
taught (he grouii« unrler l»oth plans, the cniiHislency of the superiority 
in giiina shown by llie Siudy-teHl inethod is indicative of n genuine, 
oven if small, cUfTercuee. Tlw average aupcriorily of tho Htudy-lcat 
plan in the two grade levcla baaed on four hundred and sevonly-soven 
pupll-rocordh is 1.05, or approximately Iwn per cent. The advantage 
is slightly higher (2.11) in (he necoiid f^iidc and lower (1.30) in Grade 
Ilf, Whether this kituiII advantage, amimlng it to be genuine, is 
sufilclcnl lo tlomonMlrnle superiority of Iho Htudy-lcHt plan in general 
in these* grades is a topic for consideration later. 

Beginning with tlmsecoml half of Grade 111 and continuing to Iho 
end of Grade VIII, the Teat-«ludy plan shows slightly greater gams. 
Aside from one small setback in Grade IV and another in Grade VII, 
the Bre-lefit sclieme slmwa lo ndvantage in all of thi* dozen compan- 
sons, Tile surplus in favor of this plan is consistently riiulII and 
often lacks "milisfaelory" .alatiHlieal reliability. Tlie advunliigcH, 
beginning with the lowest grade«ure:0 53, l.Ifi, “0.50, 2.00, 2 80,1.01, 
2.84, 3.57, 1.70, -O 80, l.Il. The average of lliew figures, bused 
on 2^123 pupil-records, is The senes shows no eunsistent ilevm- 

tion from tliin average mirplua in favor of the Test-study plan. 'I'lio 
plan, in oilier words, begmiiing at llie nmldle of Grade III, seems Lo 
work us well, relatively, in the low’er im in the upiiei guides. 
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Cc^sfpjiniiiOK or RmLn« f^ fiRiotrr aku nuu. ^ 


An InspecUan of TahW I ihe sly»i i^*u<ly- 

U^fe pUa shewH to gft?at4?ffi advani-ag;*^ tn dollar pujri^ 

whereat the Tc»t-#ludy molhcMi m^w foitr?! i« jb«" ^nghi TaH® 
mis ohtalned by laMug; from tmeh grstdf’ «hr bnRhn*’^'! and sk 

dUUesfe olasm. I'^h cto waa tsughi by iHi* fir<^t b| 

otto method and then by to tsUw. Bimw ilw m\hd wry** c^.m* 
jwaod of different worcb and giwii at diffi^rent unn <*, pof*i3»k' juiual 
BQor^ were oflaii different To weure groups pi’’ israrly pa^jnn.drni 
as possible on the infUal h^t acorvs the iw»rih 

Tftblo rilshows tot in Grades II, IH, rimJ IV, sh*‘ duH« '‘f jHipilfi 
iMde greaioT gains when Unght by lite pinn, hi th-intra 

Y| VI, Yll, and VTII they do as well when taught l»y the 'iVst-’^iudy 
method. The brightest alams on the whole miihe larger ganw when 
working by the IVfl-atudy plan, Tliere are law alaiw*!!, hi (hade 11 
and Omdo VI, in which Te«t-«fcudy shows no ad\*ftniagi". “Hie avi rwRc 
BMperiorlly of the method h l.fll, a ftipiro slightly greatr-r thitn 
the average gain of 1.40 poreenU^ for the eniin* fwi|mli»noM of 
the sehool. 
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Com^rimn o/ Mcihada m fypflhng 

In Urms nf thp gflinR In nbility In f<pc?ll Ihn words aftc^r an interval 
of from one to ten weeks' after the words were studied the results 
show thcf Bludy-leal melhofl in be slightly lx*lter in the second and 
first Imlf of Cirndo lit, whereas Hit? Test-study method is 8ii|>orior 
thcrcafUr. In the ca^?/* of tlm cIuIIpsI of the four or five clnssc* at the 
high third and ftmrllt gmtie levels Ihc Bludy»leBl plan is slightly 
superior, wlierens in the case of the hnglitrsl of Ihm* gioups, the Tcsl- 
Bludy plan i« equal to B{udy-it«tt in the second grade and slightly 
superior thereafter. Were no other faelom than thofoo resulls taken 
Into account, the it^ctimmendnfion would bo to use ilm pn^iesi plan for 
bright pupdft frcim ilie beidnmng, for average pupUa from Uie mlddlo 
of Grade III, and for the slovveat pupils from the lieginnlng of Grade V 
and to use the Pn'^ludy method In the remaining claasea. Since the 
advantage of either method isamall In lerma of specific spelling gains, 
it will be nensible to consider certain other factors. 

Let us consider first cerlam limitnlions urged against the Pre-test 
method In comparison irilh the Pre^iudy pmcedure. One frequently 
mentioned limitation nf the Tost-aludy method lies in the fact that a 
alngle dlctalkm lest is not a wholly rt^liablc means of delermlnlng 
which WiJrds a child can spell conreclly. In tlie first place the leal 
puts the child into a slate uf cancenlnilinn on spelling. A word which 
he might miss|M‘)l in casual wndiig or even in a diclntiou exercise 
In whicli attention is jiartly cIcvoIchI to meaning or coinposilion, or 
both, may In’ correctly Hpellwl when nlleiition is entindy devoted to 
spelling. Thus words iiisufficieiuly mastered are onulU'd fnun atudy. 
In reply to this objection it may lie wild, however, that tlie IVat-atucly 
plan provides three lr«Kls (oil Moiid.ay, Wi'diiesday, and h'rhiay) and 
that words known well enmigii to 1 h‘ M]H‘ll(‘d eorrccliy tiirec times 
probably need no furl iter systeiimlie drill 

It !k urged Kiinilarly tluil ehildnm who are not cerliun as to which 
of two or Ihire allermiiive*s to u*«* will succeed fn-quenUy m gi‘Umg 
tlio right form by elmnee Tims, Kilrer* found Hint of words nus- 
spellcd in n second lest, thirly-oiie per cent vsere spelled correctly 
on the first leit. Nearly a third nf the words misspelled on the first 
teal apparently were not perfeetly known and, it is urged liy some, 
Bhould have lieen sludied. In UiIh coimeetlnn the plan of giving th(> 
pupils a brief preview nf the wnrds, us l>y reading them in printed 

' Kirirn ilic Hrml lf*»L ntrlutk^tl nii f’i|unl liHiiint'r of \uinlH from •‘to'li of llie 
wceklv Iwl^, If nrcuirwl nt mlm*nh of from oiir l« lea wei'ks iifO-r ilie \vor«h W'T(* 
aUiiticil, 

* Sdionl Jirvuw. lOJO. pp 521 TM 
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(Solumn* or ift conloxi, has* b^a m M jr. r 

fcho number ol ward* whieh a pttl«l 

thorough m&stcry. The wriiPf, <n a «B4aS! tff^s ir^S" 

thflt twenty-one per sent of tfeie «wr4f» j^3S^<S wrtriTwih'’ a w.r -s4 

test were oortect, on ib^ fim ■mUiflUS jw'trw, 

oentftgo was thirty after the ehCldwn 's*«'«'' pr^ ■®tr 

for a preview of the M. Kilm*'* finding iHa'i 

of th& words mimpelledi lafUr an talerva^ «*'? wr« ^ln 

siMlUod In a test Imraedialely after a preview h» l«««# 

similarly. 

Thetw would bo strong arKirtnwiU wrne nbr i^iudf f«f 
dotorminod enUrnly by Ibn single Xfcmthiy Th® 
on Wednesday and Friday iwm Ui be oxeelh^ntly 'mrm 

of the conditions hero rowaled. The plan iwfftB fairljr »!! u,^ 
tho amount of study to Ibe newla. With nif*« tl'r^ 

, missed on the first U^t will bo mei* poorly fen^wss ^4 
SUmably most in need of the greateiri. awmint ^ Misdy K^n Xnf<i4rjf 
attd thereafter In case of a rop^tod fatlufr f*n 
tirWlwise, tho raero fact Uiat a ohildspti^llsfl word ijrtmr’Jlir««» 
even If he falls later, is evident of a gmipp «4 k.w4s»ji *fv4ii 
if ho failed entirely. A word spoiled wirwNsiIy <>« b«fh jM-'ff.iSisy 
Wodnesday is, with rare oxc^Uon#, aUll heUrr hnnwrs, mA # frx-jd 
Spelled oorrootly on oil throe day« la jifolMibly k««wti w4l wf^«h 

should over bo taught through dimet drill In iilir< If 

BUoh a word is mi^peUed sU montba later, ihe esptmnaiiv^w 
, to be found In tho intarferibg luOuanec of iwrrl« mj h-%3ti*4 

pr to lack of uso outside of the spoUing leawn« during she 1 m 

tho latter enso the remedy l« not more drill but bPilrr ?i«a<8 

placemont of words. A word not u?^ uniil wiMUihfs fi^wr gs W 
been taught haa l^n introduced at l«a«t pbs moniha Wt ImSf a»i 

of studying it more, the pupils ehouhl tioi havi» atudii?d li di 
time, 

With rcforouoo to Iho mattagunient of the cMy words' 
words already known well enough lo Ije spellt^l lifl rsm^ irar 

more of tho throe UfHU--tho Tc@if-atudy phm l« Uw wriirr 
have all tho bettor of Uio argumoni. Ii is, in fwus, ntoSy d!ti 44 i@^p(| 
to WVQ tho pupil from needlesa ovcHoaming of wnrek bo c^n ahTt^ady 
Spell with Bomo inoosuro of oomdstency. Tho tiireo t^ia will ror«dy 
let a word allp through without praeUoe If it really na^ drill &i sW 
time. No method can control all of Use exigonelea of fuUtro ©venSss*. 
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Concerning the Irculmcut provided for the moat poorly known 
torda, the advantngG of Iho Test-aludy plan is usually admitted, 
'®8 plan allows on Monday, with raro exceptions, the words that a 
pupil is Irual able to spell from ihe whole week’s het and enables a 
.pupil U) concentrate on thcHC ns much os needed up to tho limit of 
the lull week. By saving time which tho Slutly-teat plan devotes 
,to study of tho cjisior words, this plan would scorn to enable tho pupil 
ife) direct his study to the words moat In need of It. 

At tho winic time, the Teatrstudy plan tends to exaggerate to the 
ilhnlt tho clTects of miaplacemcnt of wprds. Tho grade placemont 
lOf words is far from a satisfactory condition, and in most schools 
many words arc doubllcaa taught long beforo they are actually needed 
ito wriliag. Such words Will mainly be difficult words to spell because 
they have been used ))ut seldom or never. The Test-study plan 
fequircB the pupil to devote a maximum amount of time in study of 
those words. Words which \wll not be used for a long time will now 
.either bo forgotten boloro they ore needed or overioarnecl groatiy 
/to maintain IhcLr hfc until they arc called for. In either case tho time 
i^pont in drill is largely wasted. 

The filudy-lesl plan, then, may lend to waste lime on tho study of 
''easy" words already known well enough or nearly well enough for 
SUcceRsful UBflgo, whereas the Teet-study plan tends to waste time 
Upon study of "hurd” words which ought not to be atucUod until 
Ifltor, Kvidonce in «upi)ort of this view may be found in Thompson’s 
Btudy^ of the causes of dllTorcnccs in the spelling difficulty of words. 
Tlio present writer believes that his results may best be intorprotod 
as indicating that "easy" wonia, on the whole, are those most fre- 
qucnlly user] in writing, and “hard” words those least frequently 
used prior to a given test. 

With the liintlftUon in grade placement now in effect, it Is probable 
that one of these drficieneies is about as bad as the other. Theo¬ 
retically, then, tlie cunte.st may be called a draw up to this point. 

It should be pointed out, Iiowevcr, that the difficulty with tho 
TeBt-Bludy plan is not m intrinsic and irrcmcdial as the limitation of 
tho Study-test inethod. Ihunove improper grade placement, and 
this wnstpfuIiiOHs <it llm 'iVHl-aludy plan lorgely disappears. This will 
not he HO fully tnu* of tho Siudy-tc«t plan, Dospiio the probability 
that belliT grndo placement will lend to produce daily or weekly 
lists of words of more uiufonn difficulty, on tho nvorngo tho words 


'‘Op. cii 
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will still be of irnequal difficulty to individuals la the olaas. It is 
preoisoly In the funcLiou oi adjustment to individual clifTerences in 
mastery of the various words m an assigmncnt that the superiority 
of the Test-study method Ucs. The most perfect grading system will 
Boaroely make all children equally good apcllors or a given child able 
to spell equally well (or poorly) all of the words in a given assignment. 
With a perfect grading system, the Test-study plan would fiarl a more 
ample dofonac than it does under present mediocre grade piacement 
of spoiling words. 

Another defect attributed to the Prc-tcat plan more than Cq the 
Pre-study plan is the loss of study upon Avords of all degrees of difficulty 
duo to failure of the pupil or teacher, or both, to detect errors in the 
test results. Kiizor pointed out tho frequency of such errors when the 
pupils correct one another’s papers. They are likely to appear also 
when tho teacher corrects the epeUing. It may again bo said, however, 
that while errors arc likely to go unnoticed occasionally in one tost, 
it is not very likely to bo missed three limes in succesaion. The 
Test-study plan makes rather adequate provisions for oatohing such 
mistakes In time to give a word at least one clay of practice. The 
plan of having pupils correct thoir own spoiling by comparing thoir 
test papers with tho printed text has several features, moreover, of 
educational value. Apparently what is needed is to encourage tho 
. pupil to develop a higher standard of aocuracy in scoring Ids spoUtugs. 
Suoh a habit would be useful through life as an aid in the improvement 
of ability to spoil. 

Another objootlon offered to the Pre-test is that it makes initial 
errors not only a necessary but a natural result, Sinco tho spoiling 
of tho words is not always known, errors are inevitable. Since the 
making of errors is a necessary result—taken for granted—it scorns 
also natural. Thus ill-offocfcs are alleged to bo the issue. Tho first 
is the inculoating of an attitude of tolerance toward mistakes in 
spelhng. Pupils are induoed to look upon thoir mistakes with com- 
placonoy, The second ill-offeot lies in the fact that tho Pre-test forces 
the pupil to “ practice errors ” In this connection tho alleged tondency 
of initial errors to persist is often emphasized, The Study-tost plan, 
on the other hand, by teaching before testing, tends to sot up standards 
of accuracy, to prevent initial errors, ami to provonl the practicing of 
errors. 

■While the writer beUoves that tho importance of these tondonoics 
of the strict Pre-test method has often boon overestimated, ho is 
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Inclined to believe that they arc genumo and, in some measure, potent. 
To what extent the making of errors during the Pre-test lends to pro¬ 
duce a tolerance for inisapelUags, if at all, is difficult to show. It is 
not impossible, indeed, that testing, by revealing errors, tends to 
cultivate an opposite mchuatiou to correct thorn and to develop a 
sensitivity to errors which ordinary writing docs not properly cultivate. 
The general tendency for initial errors to persist is apparently far loss 
strong in spelling than in some other functions. Errors in spelling 
tend to be variable rather than constont. If a oluld cannot spell a 
word ho moat frequently apoHs the word phonetically. Most words 
may bo spelled phonetically m almost Innumerable ways, as Horn‘ 
and others have shown, and they arc spelled In many of these ways In 
repeated attempts by the same pupil. As Woody found, moreover,® 
the errors made by children in preliminary tests do not tend appreciably 
to persist m their original form. 

Another consideration is the relation of the two methods to the 
interest and effort of the teacher and pupils. Keener’s finding that 
"the majority of teachers . . . were very markedly in favor of the 
(Test-study) method” and that "they favored it because of the greater 
interest on the part of the pupils . . . and opportunity of giving help 
whore it was needed” is borne out in Public School 210. Although 
the Study-teat plan was more of a novelty to the pupils, they favored 
the Teat-study plan by nearly ten to one in a sample of votes taken. 

A problem of great importance is (hat of the amount of time 
consumed by the two methods. Adherents of the Study-tost method 
point out that relatively more clasKroom time la availalile for study 
when this method l.s used because Im lime is spent in testing. As 
commonly used, the Study-tost plan lequircs two tests per word per 
week, whereas the Test-study plan requires three weekly tests 

Adherents of the Tcst-aUidy plan reply, however, that their plan 
requires less time in absolute terms—fewer pupil-minuLos of work 
per week. The reason (or this is that pupils arc not required to study 
all words, as in the Pre-atudy plan, but only those missed on a test. 
Thus, if a pupil iniases no W(ird.s on the Monday lest ho is excused 
entirely from the Tuesday .study permd. All of those successful on 
Wednesday aio excused from ihr 'I'hui.sdsiy pencal. Koiuier found in 
his study that about twelve pin cent were, excused from Imtli peiioda. 

Sourco of (^oufuHum m Hprlling, Jouninl oj Htlucnliomd Hctcnrch, Jftti,, 
1029, pp, 47-50 

*Tho Evalimtioii of Two Molliotla of Tonchnig SiioUijig. Year lioak of the 
Nahonal Society of College Teachers of JUdHcaliont 1920 
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In the classes sampled in the present study about ten per cent were 
excused Irom both periods and about eighteen per cent from the second 
period. 

The saving of pupils' efforts is hy no means fully represented by 
the number of children who know how to spell all of the words iu a 
week’s assignment in advanoo of instruction. Nearly all of the pupils 
know some of the words. In Table II the scores on the initial test 
represent the average per cent of words to bo taught during a ten- 
week period which are known in advance of study. Those represent 
the percentage which they would not need to study under the Pre¬ 
study plan. They are approximately as follows: Grade II, thirty-five 
per cent; Grade III, fifty-five per cent; Grade IV, sixty-five per cent; 
Grade V, sixty-nine per cent; Grade VI, seventy-one per cent; Grade 
Vn, seventy-live per cent, and Grade VIII, sixty-eight' per cent. 
The average of these percentages is 62,7, Thus the average pupil in 
his entire spelling course knows how to spell nearly two-thirds of the 
words in the spelling list a month or more* before ho is asked to study 
them. The Test-study plan requires three reviews of the two-thirds 
of the words a pupil knows—in Iho Monday, Wednesday, and Friday 
tests—and conserves all the rest of the time for mastery of the one- 
third of the words which he does not know. Theoretically, the Test- 
study plan is undoubtedly well oonooived to make the most of the 
pupil’s time. It should bo realized, moreover, that a test may be an 
effective moans of learning. Indeed, in studies of memorizing nonsense 
Syllables and other materials a combination in which a solf-iost (like 
recall) predominates over more rereading, proved to be markedly 
superior to mere review study.* 

From the theoretical point of view, the surprising thing—to the 
writer at least—is the fact that the Pre-test plan does not show to 
greater advantage than it does in this study and others. While it is 
neither a perfect nor a fool-proof plan, its disadvantages seem fesvor 
and less serious than those of the Pre-study program. In the writer’s 
opinion most of the limitations of tho Pre-test plan previously men¬ 
tioned are not very serious ones, and most of these may bo removed. 
The most oonspiouous deficiency of the plan, according to observations 
of the writer and of others, is to bo found in weaknesses In tho pupil’s 

* SIhoo the lists used in tlioso tosts oovorod ten wooks of advanco nasigiiinpiifs, 
tho avorago would bo about five wooka, 

* Gatos, A. I.: Recitation as a Pnolor m Memorumg Archives of Psychology, 
1017. 
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method of study and of management of his own work and the inade¬ 
quacy of the teacher’s supervision of pupil's individual work The ' 
writer’s observations were that in the Study-test plan the'pupils 
wore held to the use of better techniques of learning, to better distribu¬ 
tion of time ou dilTerent words, to more adequate check-up of results, 
In the Test-study plan pupds were given lose adequate guidance' 
and often supervision was superficial. As a result, pupils frequently 
dawdled or morn ooinmonly utilised poor methods of study, failed 
to do their nsaignmciil properly, giving undue time to certain words 
and insufficient tune to others, foiled to cheek their work properly 
and otherwise rolased into inferior study. This wns notably true of tlio 
least experienced and least intelligent pupils, who were precisely tho 
ones among whom the method showed relatively the poorest results 



THE NATUHE OF INTELLIGENCE* 

J. n WILSON 
Introductory 

In the discussion of the nature of "general intelligence" and of the 
possibility of testing it, an important suggestion hna lately been nindo 
by Thorndike. He had put forward a list of eight tests, based 
apparently on his own theory, and has implied that they will not 
satisfy the well-known criteria deduced by Spearman and his collabo¬ 
rators for demonstrating the cdstooce of "general intelligence" 
as a "central factor." 

The issue is of much theoretical value and certainly seems impor¬ 
tant enough to justify putting it to the tost. A small research has 
therefore been planned with Uiia object in view, and the results arc 
described in the following pages. 

The Conditions Govbhninq the Experiment 

Thorndike’s list of tests consists of the following well-known 
processes: Memory for digits, pitch discrimination, opposites, defining 
words, completing sentences, arithmetical problems, number series, 
and completing pictures. 

Ho propoBoa that tests of this kind be given to 10,000 sixteen- 
year-olds, the aoouraoy being sucli as to secure reliability coelTicicnts 
of 96. Spearman accepts the tests, but adds that tlio subjects must 
^be of the same sox, that they should have received reasonably similar 
oduoatlon, and that all rosponsos to ono and the same lest must be 
uniformly marked by the same person. 

As put forward here the proposal is obviously beyond the power 
of any ono investigator. Spearman, suggeata, however, a Bomowlml 
less rigorous procedure which makes it possible to test his prediction 
First he maintains that such high reliability coefficients are not 
indispensable. Secondly he suggests that a number of mdepondent 
workers might each examine about one hundred pupils. 

* This study has been earned out undci tlio aiisj)U'p*i of llio llrighUm atid IIovo 
Higher Education Council. It composed iiart of a ihosw miluiiittpil for the Pli 1), 
degree of London University. The author w greatly iii(l(‘l)lpd for vnliiablo 
nasistanco to Professor C. Hurt and also to tlio loachons and Htudent-s who helped 
in the oxamiuatioii 
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The Tebth, Subjects and Administiution 

In carrying out tlio prewnt invcRtigation, use was made of published 
material wherever pomlrle. Thus memory for thgils was tested as 
described in Wliipple's “Mnnual of Mental and Physical Teste” 
under "auditory” and "viminr’ memory respectively. Pitch dis¬ 
crimination was rentlily measured by Seashore's apparatus and 
procedure. The verbal tests and the arithmetical ones gave more 
difficulty. Itoma were collected from publislied scalcfl; but the best 
selection for pupils of sixteen years had to be discovered by special 
experiment. Tliey were finally chosen after trial on the students 
of a training college for teachers. A lest of completing pictures was 
to hand in that used In Ihe American Army tests, namely "A Day 
in the Life of a Schoolboy.” 

To avoid any influence there may be in the day of cxaniinnlion 
the tests wore prepared in duplicate and given on two days, and to 
avoid any constant factor entering Ihu results the children changed 
scats from lime to time throughout the examination. 

The tests were given to Bome 8evenly-odd boys ranging in ago 
from fifteen and one-half to sixteen and one-half, the average being 
exactly sixteen years and one motitli. The boys were taken from 
parallel classes of tlie same form of a grammar school, the form being 
too one preparing for the Oenerai Sehonl ('erlificivle h’xamiiiation. 
In consequence of these limiiationK Jhey formed n highlyRclcclcd group. 

Each lest was unifornily marked by the Hnm(‘ person. In certain 
cases this marking was dune by Mi«.s 1). King of Brighton, in olliora 
by the writer, wJio takc'S Ihia oppoiluiiiiy of (hiinkiiig her for sucli 
valuable help. Sixty of Ihi* pupils had taken ijotli examinations and 
their reauUa were used 

Avehagb ScouKs, Standaiid Dia'iaitons and UunrAinLiTiis.s 

These values are given m Table I. 

The first point to be cunaideied is the value of oaoh lelialnlity 
coefficient. Tlie majority of the poefiicients lie between .fiO and 
.70. Ill comparison wiOi A)o, llm figuie auggo.stod liy Tliomdike, 
these results aio dmiqipumling. Consnleving, Uowovevj how highly 
selected the group is in age and ediiealimml utluinmcnis, they compare 
favorably with those of other workeiH m allied fields.* 

* Worliiit)' wiLli of niiiversilv iiuik. Ifii/lclt ohliuiicd valors wlucli 

ranged fiom .fifl down lo 29. TUn wnlor willi yiinuRcr popilfl, using ccioivalcnt 
tests from National A nn<l 'I'onimii (Snaip 'IValof AIcntal Ability, .37; fiom Otis 
and National A, C4, lunl ‘rrnnnn ami Olis, ,72 
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*the negative valuer are not i^gnificiani 
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SpBA.nMAN'H ChllTKlUA ANU iMu'liU tUlN.* 

Tho criterion Is ns follows: Take any four U'«tK nml Iri !ln* fniir 
soleolod bo donotecl by the lottora «, p, niut./. 'I'lteri, if ilu‘ HK'di' 
olontft of cortolatlon are detormlned Polcly by ii eenintl fncuir, 




23 


Thd Nalurd of IrUdUgejice 

to fcho dogren that should be pxpcclod from tlio sampling “probable 
crroi-a” involvod. The quantity f is termed the “tetrad difference." 


ArPLlCATlON OP TiIEBB CniTKIlIA 

There are tliroc hundred aeventy-oight difforent values of F. 
Each of these values has been computed, and the distribution of the 
rosulta is aiiown in Table III. From Ihis table it is readily seen that 
many values differ from aero. And, at onco thoro nrisos the question 
whether such differences are signiffcant 

To answer this questioii the probable error of the quantity F must 
be known. This has been found by Spearman and Holaingor * 
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I Thu dulrdiiition ha^ hooit iiimlo m dim way to fucililnlo tho coiiBlmotion of 
Fig. 1. 'I'liiK curve If) tin'll D^itiiiti'lncHl. 

To compare tho magnitude of each “tetrad dlfforonco" with 
lU probable error, the expedient has been adopted of dividing tho 
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The ilifTcreiu')* hflwPfn ihin nncl (lie true value ih jiuuIp up of two expressions 
involving die fourlh orders of theHlamlnnl devuitionHof the correlation copflicioiits. 
Theiio are iieghu;itplv mimll cxicpl foi amnll values of flic corichilion oi small 
number of piipilii and nm\ In* rulrulalcd Ivy inoaiis of the formula of Filon nticl 
IVarsou {Fhl Tmu'», UttyiU .s<«?, I<uiuloa, A p 202). Ileui, however, they 
nro nogligiblc 

liven Ko, the formula reiimirm very eumlieraomo iiml it has been oiistomary to 
vuw) m lU plnve cerium n)iivr^>\»«aUo«H TUw proeeiKuo will not bo followed hero 
becftUHO one of the niaiii tlinicullies oxpniioiifcd m Ihe Iheoiy of two factois has 
been dio uhu of niibHliluto cntoria for die Iruo values. On tlio contrary, tlio full 
formula bus been used 
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former by tbe latter These quotients are summarized in Table IV. 
In simple sampling a value for the quotient just exceeding 1.00 is 
as likely to occur as not: a value just exceeding 2.00 is likely to occur 
about eighteen times in one hundred trials. a value just exceeding 3.00 
is likely to occur about one in twenty-three; and for a value just exceed¬ 
ing four, one in one hundred forty-three trials. Until a quotient exceed 
four there can be no great confidence that it is likely to be “significant.” 
A value of five is usually required in statistical work. A value of 
three is, however, considered “suggestive.” 

In Table IV twenty-two of the quotients are greater than three 
and one is greater than five. These large values constitute a small 
proportion of the total, and it is reasonable to ask whether they could 
be expected on the basis of sampling errors. 

F 

Table IV —Values op Quotients ^ 
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To decide this question two expedients are available. 

In comphance with the first of these devices the values of the 

quotients have been distributed as is shown in Table V. Column 1 

gives the range of the values of the quotients, 

while Column 2 gives 


the frequency of their occurrence In Column 4 the frequency which 
is to be expected, were the distribution normal, is given. Column 5 
gives the difference between Columns 2 and 4, and these differences 
are large. 

The probable errors of the differences in Column 6 arc readily 
calculated when the cases entering into the distribution arc independent 
observations. They are not independent in tho case of " tetrad differ¬ 
ences,” for many of these contain the same r’s, and the diffeicnt r's 
themselves have intercoTielated sampling errors. Values of probable 
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errors calculated on the assumption of the independence of the observa¬ 
tions will therefore be too email. They will give, however, a first 
approximation. Such values arc given in the third column of the table, 
and in the last are to bo found the quotients obtained by dividing 


Tivui/C V.—Snowma VAniATioN prou Normality op Table VI 


F 

Quot — pj^ 

Frequency 

Frobablo 

error 

Frequency 

O'Qiccled 

Dirfcvenco 

Quot =* 

0-1 

160 

0 B 

189 

-39 

-6 0 

0-2 

271 

6 0 

310 

-39 

-6 6 

0-3 

350 

3.1 


6 

2 0 

0-4 

376 

mSM 

376 

1 

1 0 

0-C 

377 


378 

1 

1 4 

0-0 

378 

0 

378 

0 



the value in Column 6 by that in Column 3. Examination of these 
values makes it highly probable that the distribution of the "tetrad 
differences” is not normal. 

Application of the second device supports this conclusion. By 
means of Table III the histogram shown in Eig. 1 has been constructed 
In Spearman's "Mental Abilities of Man” (Appendix, p. xi) is given 
the proceduie that is to be followed in order to construct the normal 
curve to bo expected were the differences due to sampling errors alone. 
This curve is shown in Fig. 1, and it is evident there are variations from 
what is to be expected by sampling errois. 

What, then, is the cause of these perturbations? 

Before seeking the causes it is necessary to consider the question 
at issue To demonstrate the presence of a "central factor” the 
absence of "tetrad differences” in significant amounts was sought 
Their presence demonstrates that ihei*e is correlation over and beyond 
that due to the “central factor ” On the unifocal theory of Spearman 
this additional conclation, termed "specific correlation,” can only 
be due to two or more of the mental performances here tested having 
in common the same “specific” factor. 

Further, according to this view, such "group” factors (as they are 
called) have very nanow incidence 

Two methods may be employed in studying this question. First 
those values of P which arc largo in comparison with their appropriate 
probable errors may bo consideied. Examination of these "tetrad 
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differences” will help to indicate those tests whioh have “group 
factors.” There are twenty-two values greater than three times the 
probable errors involved, and eighteen of these, including all greater 
than four times the probable error, may readily be accounted for by 
too large values of the coefficients ra*, r46; 7*86, Tiaib, and rer- In particu¬ 
lar the coefficient of correlation between the memory tests occurs 



in four, those between the verbal tests m five, and that between the 
' arithmetical tests in nine, includmg the greatest value As but one of 
these values reaches the standard of five times the probable eiror, it 
is impossible to do more than say there is a suggestion of the presence 
, of a group factor among the verbal teate, slightly greater suggestion of 
one between the memory tests, and by far the most evidence in favor 
'of a group factor between the arithmetical tests. 

Recourse is now had to the second method, in which the amounts 
of “specific correlation” are computed. 3uoh computation is effected 
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by the uae of partial correlation * To apply the method to a given 
pair of teats neoessUates finding the correlation of each test with the 
central factor. The most reliablo way of obtaining each of these two 
coefficients is to use all available pairs of tests, but all coefficients of 
correlation introduced must obey the tetrad equation.t Hence in 
obtaining the coefficients of correlation of each test with the central 
factorj (see Table VI) no use has been made of the cooffioients for the 
memory tests, nor of those for llio arithmetical ones, nor of those for 
the verbal ones. The values, It will be noticed, are in the main 
small, the third test (opposites) being the only exception. 

Taiilb VI —CoEPWoiBNTa OP Satouation 


Ttar 

CoirpiciRKT 

la 

.676 

lb 

268 

2 

,040 

3 

910 

4 

.447 

6 

.676 

0 

.468 

7 

.290 

fi 

387 


The coofficients of correJation between the specific factors are 
suramanssed in Table VII, In tho same table are to be found the 
quotients obtained by dividing each coefficient by its appropriate 
probable error. There are few largo values for these quotients, 
Values greater than three occur in tho case of the two memory tests, 
also m the case of defining words and the visual memory tests, again 
in that of supplying words and opposites tests, in that of arithmetical 
problems and opposilcs and finally in llic case of the two arithmetical 

* Write Tai for tho coi relation between two tests c nnd h and rga, Sb for tho 
conelation hotivcon tho factor spcuific to a nnd that specific to b, and there ensues 
by tho formula of Yxilo foi paitinl couctation, the equation 

^ fa b ' ' 

= Vl - -”rv 

whore g denotes tho factor common to both a and 6. For the correlation between 
tho epocifio faotoia will ho that found when g w held constant Theao values have 
boon found for all llio possible pans of tests used, 
t Lot rat bo tho coodiciont iC(|Uiicd, then 

J fatt ~1~ I rtrnd -b ‘ 4* fatfay d* • 

I ^ rt# -f- + • • + r»v + • • 

0 , b, c, etc., being the tests 

t Those coefRcionta aio technically toimed “salmation coefficients " 
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testa. The only aignifioanfc value is that olitnincd for llio two arith¬ 
metical tests. 

A further investigation may now be attempted Trlriid difYerences 
may bo selected in the following way: 


Tadlb VII —C 0BPFICIBNT8 f>y ComitiiATiOM hltwbbh .Si>i«-irif I'v rnjtH 



Take any four toats, including only one at a time from the verbal 
tests, one only from the arjtlimcticnl tests, and one only of tlie nnunory 
tests. The coefTicients aro dctcimincd solely by a ‘'central factor," 
and the tetrad equation ought to be satisfied to the degree to be 
expected from the sampling errors. 

Table VIII— Tetrad Dikfehbnolu Prbdictrp as ,Satihk\i.s’o CIhitbuia 

(N « 120) 


a WOE 

1 IIBm.’l!Nl.r 

000- 01.^ 

23‘ 

015- Q‘15 

36 

045- 075 

3r, 

075- 105 

13 

105-.136 

8 

136- 166 

2 


1 The dietribution Urb been wiado m thw way lo rucdilalD liiu conn1r«tUioi\ of 
Fjg. 2. This curve thus boeomoa syinmoliicnl. 

This may bo done by constructing a aerios of tables Hiinilar to 
Table II, m each of which is placed a selection of four of Iho tests. 
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In thjs way forty sucli tablw may be coiistructcd^ and /rom each tabic 
tliero wU! cnaue three values of the quauULy F, mnkjng u grand total 
of one hundred twenty. These vnlucs aie distributed in Table VIII 


'Jahi.k IX- QiumfiNTrt ” j,g or F 


QcortKHr •• 

VneovKHct 

From 0 to 1 

. 47 

Ciroiiter limn 1 ui> lo ‘2 

40 

Gronlcr tlmn ‘J u|i to 3 

22 

GrcAlcr tlmn li up to i 

2 

Greater tlmn •! up to a 

0 



in a form suitable fov llio formation of the lustogram given in. Fig 2. 
In tlic Hiuno figiiro is diivwn th(i nonnal curve to be expected were the 
dilTovencoH duo to Hiiinphng citoih. Table IX and Table X have boon 
modeled on linos siinilav to those employed in Tabic IV and Table V 
refipcotivoly. 
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Tadi^b XIU.—SmuFic CojmBiimoNB 
i\r fio 



Ift 

2 

: 3 

■1 

a 

1 

: ^ ; 

8 

la 


■lil 



~ 105 

" I.V2 ; 

[OS , 

•1 008 

'2 

BWhll 

1 ^ 

BXi3 



b 174 

- 030 

177 

3 

1 + 2S)1 

+ 017 ; 


1- 110 

-.171 ' 

- 002 ' 

- 173 ' 

126 

■1 



^ + 140 


1 120 

- 010 

m 

•1 200 

5 


-,161 

1 “ 

-1 120 


1 MO 

1 032 

■lOQ 

6 

- 17)2 

4- 174 

-.002 

- Oil) 

d 111) 


■[ 42!) 

■lil 

7 

- 108 


- 173 

~ 148 

•1 0.32 

1 420 


1 160 

8 


- 177 

- 125 


4 308 

- 1)33 

-1- 1.60 ! 



and Opposites. The values arc only "suggealivo," and among -so 
many values (thirty-six m the fiist experiment and 1 wcnty-iaglit in the 
second) can moat reasonably bo accounted for liy Huinpling errors 
It IS interesting to note, however, that specific coirclalion Iins been 
manifested for boys and not for girls in at least one experinient/ 
though it must be added that in it llie tosU involved differont menial 
piocesses 

SuftlMAnt OF TUB llHHULTrt 

1. The results obtained with the tests used can readily be explained 
on tho basis of a "central factor” rumniig through all (he inafonnnnces 
find a number of other factors spccifio to each pcrfornuuic(‘, jirovidtal 
that the two specific factors belonging leapcdively to the milhmcUcal 
tests overlap. 

2. Theie is, then, conclusive evidence of a "gioup” factor in llie 
arithmetical lesis, and this lesult agrees with thohO of Uogers^ and 
Collar. Such group factoisai'o of giontimporlance boili tiaMindically 
and practically They are tacitly assumed in all work (»n "Hpceiul 
abilitLos” suoh as "practical ability,’* "musical ability,” mid the like. 
The demonstration of their presence has been made in but few ea^'i's 
The reasons for tliis lack of exjwiijncntal evidence are nowheic inoic 
succinctly put than by Piofesaor 0. Burt.® llo wuteH, "Over specilio 
inborn abilities I need not linger, Por Ihnu efTeclive tests have pioveil 
disconcertingly hard to contrive. Simple corielalinn ih lioio iniijipli- 
cablo General intelligence la ahvayn getting ni lhi‘ way. We fbmli 
we have tested something specific. We find we hnve only bit upon 
another tost of mtolligonco. Its ubiqiiUoiiH infliiKMei! euii only be 
eliminated by some clnboiate teohnical device, tiui in'iioedure, for 
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cxfimpl^j known m‘< tmiHipIr* cnrn'Iii(irm; urid liic* complcxily of the 
wholo (iisk b(‘Wil(i(Tfi ^^Ilr•rr it diwH mM biifllo.* 

Xur flo llic*"* “p* I ii'l rllfllnll^ll |ir4H<niiiii)i}v lulmni, di'clfirc* Uu'iiihi'Ivph 

fit w jouiiK (Ml «KP »iH i1m> iimT*' KMO'rnl (Iiihtik Uip firil twelve 

yCfiFH of I’liihlliofid »'< till' (■\*'*nli»in rMMirr (Itaii Ojf nili* . (lie \oiiiik child 
coiilniriH in frewh loid tluroviiU » I'lmji ihp ginnii uf evi-rv finuhv Af^c nloiu' 
bt;lrfv>rt our i(liiixMU'rn'<M ,« Arl«ih“u nu* is |ir<i>nnM<'nlh llie period Vrlieii luniiv 
of tlic'si' Ini’iilircd I'd' iiKoJid i »li?p d ni(<>rr for llic Prut turn* (o iiialiiro, 

Acenrtiuigl}/, rjforlt ul I'W'olioii'W g»ttl4$urr /nvl rtlur»lu>ml BjifruihTulion imsl 7 U)l 
beJorerU <il tun ftrlp o ^ Mnlii i Miiiie t Al pnwnt, for I'S'iinple, llio a.VHleiii 

of jiuiior <• 0110 ^ Hidiolriidn|»4 PomIs Io hwi i-p nil our liriKlitest eliildren nt llio ntjo 
of ten or clioeii into rseionilnr' *0 IhhiN of n •wnijf ¥• hat nradeiiue, type. M'lieu nt a 
later i»cuod e\onuuanv»H't nn-1»‘ hi (or Itnde K*h<H)l>4, most of tl\i‘ host insltuipcB of 
Bprcml Iniciil nre iiii»‘iiiw t!u‘\ lm\o nlrpnd\ lipi*n ereaiueil ofT and drafted into 
other directions le»^ oiiti i| (o (hoir 

AiunuK lhi‘ ulii'n* "Kiciup" fuf'lrirn do becoinv of npprccitvblo 
magnitude (he live npist inipurliuu lm\M‘ Ihtii in r<*}ip('ct of wlmt may 
bo called llu‘ luKir'd, (he nHTlinnintl, the psycholopioal, the iinUi- 
inclicitl, and (ho inuMoal ubiiihra fii vaeh of llie.so a group factor 
lins been diseoviued of miIIii'muiI, hriMullli nnd dcgice to possesH Hoiious 
pmolical conHeipu'iices (uhioaliitnal, iiuhisumb and vocational. 

3, (Iroiip fufloiH ail' pvidontly nlwnt ovon wluuo they miglit 
ollicrwiHv Imvc hrm I'spccliMl. Thm* is, for oxample, no domon- 
strnied group fuelor in tin* verbal Irnls nor one in Llio memory tests. 

Particularly cvidcnl is ibi* lack of a gioup factor between the 
opjmviti'M ((Hi and tliai of (NiiiiiiK worda, for both tests appear to 
depend largely upon unduslinidiiig llie mraning of words. Yet in 
neither of the l\so e\penim*ntH ih there any approciable specific 
corrcliilion. The amouiil of eoiielulmn between the specific factors 
in the memory tesN is Ingh but noLHignificunt A .similarly high value 
was ohtaiiie<l hy f’aiey, m wineli case iL was significant 

■1. The iiiveMligation mmvcs to tiuow light upon a comstilucnt of 
the specific faeliu.s of an olivious kiiiil and yet not unlikely to possess 
great imporlaneo It eonaisls ni llie manner of pioscntation of the 
task to the pupih In llie ease of the veibal and aiilhmetical tests 
lilt! preienlnlitiii wau made liy writing The presontiitioii was oral 
in the ea^e of ilie lesN of “ambliuy meninry” uiul pilch discriimnation 
anti was liiith victual and ‘U.d m those of" visual memory” and "picture, 
coinpledon.” 'I'lie evidence denved fioin this investigation would 

* 'riu'ic words w'l H' w I itO'ii 1)1 fun* tlie imlilieulioii of Ihc iJiotinblo eiror of the 
''tetrnd <liflfci(‘iin- ” 
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point to there being no speoific correlation in the mode of presentation, 
The choice between oral and written tests, then, would seem to intro¬ 
duce no group factor of appreciable magnitude. 

6. The “coefficients of saturation” differ for the different tests 
and also in the two experiments. For the boys, pitch discrimination 
contains but very little of the “central factor,” while the amount 
for girls IS appreciably higher. A similarly well-marked difference 
occurs in the opposites test, in the supplying woids test, and in the 
number senes test As to the test which gives the best measure of the 
“central factor,” this obviously is the opposites test in tlio case of 
the boys and the supplying words test in the case of the girls. 

6 To be effective m the evaluation of amount of the “central 
factor” present m any particular testee’s performance, a coefficient 
of satuiation in the neighborhood of .995 is needed. None of the tests 
used in this investigation even approaches this perfection. 

BlBlilOOnAFHV 

1, Vide Psi/chological RevieWj 1922, Journal of Educaiional Psifchology, Vol. XV, 
1024, pp, 194, 303, ibid , Vol. XVI, 1026, j>, 423. 

2 Maefarlane: British Journal Psychologyt 1025., Mon. Supp , Vol. XIV 

Rogers and Collar Columbia UnmrsUy, Contributions to Education, No 130, 
1923. 

3. Burt: "Presidcnlml Address to British A^ciation for Advancement of 
Sciences, 1023 '* 



ON PAKTIAL COIIRELATION VS. PARTIAL 
REGRESSION FOR OBTAINING THE 
MULTIPLE REGRESSION EQUATIONS 

UAHOIiD V. GRIFFIN 

35nr(‘fcft HpringH, Arkansas 

The Reques&ion I'kjTJATiON in Edtjcationae Psychology 

In the physical sciojices, where exact experimental conditions are 
.comparatively easy to maintam, it is possible to predict ivifch con¬ 
siderable confidence Iho olTcct of a given set of causes under like 
conditions In educnlional psychology, as well as m many other 
fields, we are imablo to isolate factors with sucli ease. It has therefore 
been necessary to develop a technique by which one may draw from 
a mass of data, often connicting, some conclusion which will represent 
the most probable relation between variables. Tins is the correlation 
technique. 

Correlating two variables, however, is but the beginning of serious 
study. The cducationiil psychologist seeks means of prediction and 
contiol For example, no sooner wcic wo measuring intelligence 
than we wore correlating intelligcnco with school marks, obtaining 
regression coefficients, and attempting to forecast school success, 
hub as intelligence teats correlate only from O.IO to 0,06^ or so with 
school marks, oducntois began to use the multiple regression procedures 
to impvovG their predictions. Thus, May® sought a better predietion 
of collego success by including time spent in study as a third variable. 
This pioduccd a multiplo correlation coefficient {Ea ij) of 0.824, 
which was considerably better than the simple correlation (roi) 
of Intelligence and college success, which was 0.00 

Difficulties in Present Procedures 

Multiple regression equations might be employed to a much greater 
extent were it not for the difficulties, both real and fancied, of the 

^ AcorioJation cooflioiontof U 40 line but eight per cent foicRtiating olTicioncy, and 
ono of 0 65 lins but t^voIlty-^lVO poi cent Hco Hull, C. L : Tlio Cojiclafcion Cooffl- 
cient and Its PiOB»n>sLin Hijumhcancc. Journd, o/ fiducaUonal Rc&darch, Vol XV, 
1927, pp, 327-338; also Wallnco and HncfIc»’or; "Correlation and Machine Caloula- 
Uou.” OfRoml PubhcivUon, Vol. XXIII, No 35, Iowa Stato College of Agiicul- 
luro, 1926, p 17. 

*May, M. A.. PrecHcling Aendemio Succre?, Journal of Educational Psy¬ 
chology, Vol XrV, 1923. pp. 420-440 

SC 
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procedures now in vogue There are two general methods of obtaining 
the multiple regression equation, both seeming to have originated 
with Yule. One is the partial correlation method, the other is the 
partial regression method. The former is at best tedious and inade¬ 
quately checked but, given time and patience, by it one oan handle 
almost any numbei of valuables. The latter solves by means of simul¬ 
taneous linear equations, but the techiuquo that commonly has been 
employed, determinants, is very difficult to handle with more than 
four variables Foi a three or four vaiiablc pi'oblem, the partial 
regression method with any type of solution is much swifter than 
paitial correlation methods, FoiLunately, there nie methods for 
solving simultaneous linear equations that are superior to determinants 
and are capable of handling efficiently any number of variables 
One such method, the Doolittle, has long been used by the United 
States Coast and Geodetic Survey and by some civil engineers. The 
purpose of the present paper is to bring this method to the attention 
of a larger circle of educational psychologists than at piesont employ it. 

Historioaii Development 

The possibilities for prediction in the rogi'easion equation have been 
known only to the present generation, and the very concepts of 
correlation and regression are not much older. An historical survey 
of the development of these concepts may reveal why procedures in 
obtaining the multiple regression equation and also efficient methods 
for solution in intermediary steps still lack standardization, 

Bhayais and His Ueputed Discovetues 

August Bravais, a French geologist and mathematician, was once 
given credit by Pearson for devising (between the years 1838 and 1846) 
formulas for solving correlation and intercorrelation between two and 
three variables.^ But earlier ideas with regard to Biavais^s place 
in the history of correlation have undeigone modification. Pearson 
himself now holds that Bravaas, while working with two and thieo 
variables in geodetic work, developed relationships between his piod- 
uct-sums and Gauss's mean-errors (our standard deviations) which, 
had these relationships been developed, would have led to symbols 

’ A . Amlyflc. Ma-thfeivatwivv®. Sar ies BiobnbfiiKLs Snoms i\o 

Situation d'un Point, Mtmtyeres Acadimuques de la Uoyale ScienlifiQue Ijistilule dc 
prance, Science, MaMinaligm el Pkysi^, Vol. IX, 1840, pp 265-332, 

Peareon, K degression, Heredity, and Panmixia PInl. Tram, of the Royal 
Society Ser A , 187,1896, pp. 263-318. (See especially pp. 261, 287) 
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equivalent to our correlation cocflicicnt. It is doubtful, however, 
whether Bravala was even thinking of correlations between his observed 
quantities.* 

GALTON AND TUB CoNCErT “r” 

During the middle of Iho 1870'8, h'rancis Galton was seeking a 
numerical mcasuro for “rovciBion.” At a lecture delivered at the 
Royal Institution of Great Britain, February 9, 1877, ho presented 
a symbol for such a measure, and symbolized it “r.” Furthermore, 
he presented it in an oqualiM, c®i «= wVfl ~ ^’“)i which, of course, 
may be written r = -s/l — In these formulas, v — the 

variability of a family of sweet peas, and c\ = the variability of the 
general population of eweot peas That Galton was clear in his 
mathematical rcafsoning nmy be seen by comparing this formu la wit h 
Mill’s formula for tlic mcasuro of correlation, r ~ -y/ l^ 
or with the correlation latio in its original form, — <r^ny/(r%. 

Galton’s Icctuio was published m iVoiure, Vol. XV, for 1877, whore it 
may be consiiltcd ® 

About ten yoais later Gallon developed an empirical method for 
determining the eorrolation between two variables. Ho made a 
distribution chart and diew a line across it in such a way as to touch 
as near the mean of as many rows as possible Ho then measured 
the angle of the deviation of this line of best fit from the vertical. 
The tangent of this angle gave him his index of reversion, or ^'regres¬ 
sion” as he was now terming it. Tangents were used because they 
swing from -j-l.OO through 0 to —1.00, thus forming a very convenient 
measure of varying degrees of deviation fiom perfect positive to perfect 
negative. For some Lime this r was called Galton’s function, due to 
the use of this term by Weldon who applied eorrolation in his measure¬ 
ment of vaiious sea life,* 

^ Pearson, IC. ■ Notes on tUc Ilisloiy of C5oirelation BiomelriKa, Vol. XIII, 
1920, pp 25-46 (Sec espccintly pp 28-32 ) 

Darmois, G ■ ”Staliatiqiie MailUmaltgue," fiiat edition Octave Doin, Pans, 
1928 See p 24Gff 

* Mills, F. G.. "Statistical Methods Applied to Economics and Biisiness,” first 
edition Hcniy Holt and CJo , 1024, pp 437, 442. 

’ Galton, F : Typical Laws of Iloiedity. Nature, Vol. XV, 1877, pp 492-406, 
612-614, 632-633 (Sco especially pp. 532-633.) 

<Woldon, W. F. U. Ccilam Corielaled Vnimtions in Cmngoii Vulgaris 
Proceedings of the Royal Soeicly, Vol LI, 1802, pp 2-21 

Weldon, W. F. R. On Ceitam Conelated Vaimtions m Cnrcinua Moenas 
Proceedings oj the Royal Society, Vol. LIV, 1893, pp 318-320, 
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Edqbworts and the Tehm “Cobppicibnt op Coihielation" 

F. y. Edgeworth (1892) dealt with Gallon's function for three 
variables, and indicated how the method might be applied up to six 
variables, making the assumption of normal distribution. Ho used 
the phrase “coefficient of correlation” instead of rovorsion, regression, 
or Gallon's function, and the term persisted,^ 

Peakson and tub Product-moment r 

By 1896 Pearson (Footnote l,p.3G) hadintroducod the product-sum 
method, enabling the coefficient of correlation to bo calculated withour 
the use of an isopleth or thread. Since thou wo commonly speak of the 
Pearson product-moment i. Many interesting variations of the 
Pearson product-moment formula have arisen since Us first statement. 
Symonds has listed some fifty or more variants.^ 

Yule’s Two Methods in Multiple Corhelation 

Partial Regression Method. —G. U. Yulo, then an assistant of 
Pearson, gave a discussion of the product-sum methods in their 
applications to correlation in two papers published during 1897.® 
In his paper on the theory of correlation Yulo obtained partial regres¬ 
sion ooeffioienta in a three variable problem by solving an observation 
equation sot up by the method of least squares, using determinants. 
Merriman, whose “Textbook on Method of Least Squares”' (sixth 
edition) Yule used for setting up bis equation, suggests the Gauss 
' direct method of solution (the basis of the Doolittle method) on pages 
61-66 of the edition used by Yule, but the hold of the determinant 
method of solution seems so strong on British mathematicians that 
neither Yulo nor his immediate followers profited by Morriman’s 
suggestions We thus find that our newly lovivcd partial regression 
method was really the earlier method for obtaining relations between 

^Edgeworth, 1*’. Y, On Coriclatcd Avciagcs Philoaopincal Magazine, 

Series. Vol XXXIV, 1802, pp 190-204 

* Symonds, P M, VauaUona of tho Product-Moment (Penrson's) Cocflicioufc 
of Correlation. Journal of Bducalxonal Psychology, Vol XVII, 1020, pp. 408-409. 

*Yule, G. U.’ On tho Signifteanoe of Biavaia’ Pormulao tor llegression, Eto., 
in the Case of Skew Correlation. Prowdings of Oie Royal SacUly, Vol. LX, 1807, 
pp. 477-489. 

i Yule, G U.: On tho Thcoiy of Corrolniaon. Joximal of iKo Royal Rlaltalical 
Socicly, Vol. LX. 1807, pp 812-854. 

* Merwmnn, M.i “Textbook on Method of I/cnsb Squaios.” Now York; John 
Wiley and Sons. (Many editions, tho eighth la of 1911.) 



Partial CorreUUian Patital Ite^rmion 30 

Ihfee or more variables. Failiufo to apprccialc lli© uso that could 
<1)6 mode of Iho coefficient of mulUpio correlation prevented the 
dovotopmont of the partial regre^on method for somo ycarfl. As 
(late as 1900 Yule could write,' “No pmclical use has, wc believe, been 
iffiado of (the coefliciont of mulUplo oorrelatlon] . . . but it appears 
.to have considerable importance, and may lie Indioativo of the olosonesa 
0 f the causal conneclicm boiweon one variable and the joint influonoo of 
two other variables of which the Arst ia a function.” 

Partial CorrekUion Method .—It was this pursuit of causal oonneo- 
ilOQS that diverted the partial regression method. Yuto had been 
attracted to the possibLlities in partial corrolallon for determining 
causal relationships, Consequently iie developed a method for 
solving partial ris that leads indirectly toward the oooffioient of multi** 
pie correlation, but is vary laborious. As yet ho had netthor named 
nor symbolized the regression cocAlciont. Yule was a careful Investi^ 
gator and a poinalakiug reporter; Utcreforo his writings carried the 
weight of authority, and the methods and terminology that he preferred 
became the aoceplod standards for other Btntlstioal workers. In 1007 
Yule presented the eystom of notation substantially as used today.^ 

It was at this time that b was introduced as the symbol for the regres¬ 
sion ooefTioiontj and that a system of subscripts was developed tp 
represent dependent and indeimdont variables. Yule first published 
his "Introduction to the Theory of Statistics"* In 1910-1911. This 
hook has boon exceedingly popular and lias run into many editions, 
ft has served to oodlfy Yulo's methods and techniques, so that stotisti- 
olans who have boon intorcalod primarily in obtaining regression 
equations, yot only incidentally In partial correlation, have patiently 
developed their equations by hia partial correlation toohnlquo.'' 

Systematizinq pAimAL ConnEDATioN Methods 

Truman L. Kelley systematized Yule's partial correlation procedure 
in 1914 BO that one needed to find, for example, but seventy-eight 

‘Hookor, It. II. fttul Yulo, (* 'U. Noto on ISslimnUng tho Ilolativo In/luenco of 
Two VariabicB upon a Third. Journal of tho Royal SliUisUcal Socicly, Vol. LXIX, 
1000, pp. 107-200. 

*Yulo, 0. U.: Oj» Iho Thoorv of Corrolalion for Any Number of Vanablea 
Treated by ft Nwv SyeUnn of Nolulion. Proceedwp o/t/io Royal Society (iSsne« A) 
Vol. LXXIX, 1907, pp. 182-193. 

*Yillo, Q. U.: “Inlrodufltion to tho Theory of Stntiatics,” sovonth edition, 
revleod. CharloB Griflln and Co., London, 1024. 

'Yuloj IbUl., pp. 226-2*18. 
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partial r’s and one multiple r in a six-variable problem if one were 
seeking the regression cquaUon ‘ Yule’s complete method would 
require two hundred forty partial r's for a six-variable problem. 
In 1917 Curt Rosenow made a further analysis,^ reducing the number 
of partial r’s to forty-five m a six-variablo problem, but requiring four 
incidental multiple r's in the process. C. L. Huffaker’s schema® 
requires forty-six partiala, bub only two mulliples—one of these merely 
serves as a check on the other. The schema for three-, four-, and fivo- 
variablo problems employed by Henry Garrett"* resembles Iluffakor's. 
J. E, Bathurst has extended Huffaker’s schema to include seven and 
eight variables * Yule's complete method requires three hundred 
fifteen partials for a seven-variable problem, and five hundred eighty- 
eight for an eight-variable. Bafchurat requires eighty-three and one 
hundred twenty-nine respectively. In 1916 Kelley contributed a 
cleverly worked out set of tables bo assist m solving partial correla¬ 
tions.® The first edition of this was soon exhausted, however, and, 
for various reasons, it has never been reissued. 

Return to Pahtial Rbqhession Methods 

In the herculean task of gathenng the data and publishing tho 
results of the Army psyclioLoglcal examinations a more direct 
method was required for finding the regression equations Brown and 
May, at the suggestion of Karl Pearson and Raymond Pearl, used 
simultaneous linoar equations with solution by doterminanta,’ as 
Yule had done nearly a quarter century earlier. Kelley then turned 
his attention to methods for shortening the determinant solution of 
tho simultaneous linear equations. In 1921 he published a nomo- 

1 Kclloy, T. L : "Educational Guidance,*' (fiist edition), Tcacliors College, 
Columbia University Contributions to Education, No. 71, 1014 

* Rosenow, C i "The Analysis of Menial Rinctions." Peycliologicnl Mono¬ 
graphs, Vol XXIV, No. 6, 1017 

*Hu(Taker, C L. A Contribution to tho Technique of Paitial Conclation. 
Journal of Apphed Psychology, Vol VII, 1023, pp. 135-142 

* Garrett, H. E . "Statistics in. Psychology nnd Education," first edition. 
Longmans, Giecn and Co., 192C, pp. 223-231, 240-261 

“Batliuist, J. E : A Partial Coirolation Schema. Journal of Applied Psy¬ 
chology, Vol. XI, 1027, pp. 166-104. 

* Kelloy, T. L.: Tables; "To Eacilitnte tho Calculation of Partial CocfficicuUof 
Correlation and Rogi cssion Equations." fiallchnNo. 27, Univeisity of Texas, 1010 

’ Yci'lces, R. M.; '‘Psychological Examining in tho United fitatea Aiiny." 
Memoirs of tho National Academy of Soicnccs, Vol XV, Govoininoiit Piiiitnig 
Office, 1021 
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gram,* for faclHtaling compulaiioo o/ Iho parlial regrcasion coeffi¬ 
cients. That same year Clark L Hull published a description of a 
nomographic method for solving parLial correlations,*but his alinomont 
board was suggested by the partial correlation technique and IColley’a 
‘'Tables" of 1910 rather than by iho partial regression method. In 
1923 E. R. Wood prepared nomograms for solving the formulas 
for partial correlation coefficienls and the foriimlas for partial regres¬ 
sion coefficients. Wood's charts consUlulo by far the best graphic 
solutions for those two formulas yet proposed, but unfortunately they 
have not yet been published commercially,* Symonds, following 
Kelley, made a job-analysis of determinant solutions in throe- and 
four-variable problems, and published charts based on this method.^ 
But solution by determinants proves troublesome beyond four 
variables.* 

‘Kolloy, T. L “t’lmrl Ui Fnnlilate the Calculation of Partial CoofUcionts of 
CoiTolatioti and llc(;rea<iion E(|uaUoiiii,” Aral edition. School of Education, 
Spooia! Monograph, No 1, Stanford Univeraily PublicationK, 1021 

Kolloy, T L \ "Alignment Chart of Correlation Functions." Stanford Uni¬ 
versity Publications, 1021 

Sco also, Kelley, T. L : "Statisticai Method," first od. The Macmillan Co., 
1923, pp 201-205 and inside liaek eovrr, 

C. L : A Device for Dctennining Cooffioicnta of Partial Correlation. 
Pi^jcholoQical Vol, XXVIll, 1021, pp. 377-383. 

*Wood, B. It.; "A Chart for ObUininK Partial Correlations and llogrossion 
Equations of Threo or More Variablee." To be laavied by tho University of 
Chicago Press. 

^Symonds, P. M : Job-nnalysia Shoot for Computing I’arlial and Multipio 
Cooffloionts of Correlation and llcgrossion Coofiicienls. Teachcra College Record, 
Vol. XXVn, 1026, pp. 62-00. 

Symonds, P. NI.i '‘Partial and Multipio Correlation Chni't, Throe Van- 
ablos." Toacliors C’^lloge, Columbia University, Bureau of Publications. 

Symonds, P. Af.' "Partial and Multipio CJonofation Chart Four Van'afaios " 
Not now listed for aalo. 

* For methods of solution by dclcrminanta see, Whittaker, E, M and Robinson, 
G.i "Tiio Calculus of Observations,*' second edition. Blackio and Son, London, 
1920, pp. 71-77, 231-234. Tlio first roforcnce is to Clno’s molliod of solution 
Doming, II CT : A .Systematic Method for the Solution of Sitmillancous 
Linear Equations. /Iwicricnn Miti.ken\atical Moniidy, Vol XXXV, 1028, p]) 300- 
803. An orderly application of Cliio's luolhod. 

nanus, P. II.' "Elomonlary Trcatlso on Tho Thcoiy of Detcrininants,’' first 
edition. Gmn and (Jo., 1880. I<nrgoly follows thomothodB and practice of Muir, 
Salmon, (}.: "Lcbsoiis Introductory to tho Modern Iliglicr Algebra," fouith 
edition. Iloclges, Figgis and Co., Dublin, 1886. Fourth edition lepiint, G E. 
Stechert, Now York, 1024. A thorough introduction to doteniiiiiants following 
tho mctliods and piaetices of A. Cayley and J. J- Sylvester. 
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Itpration Metuops op Solution 

There arc, however, other ways by which simultancoua linear equa¬ 
tions may be solved. Carr* lists some six or seven direct algebraic 
methods, There are also certain Indirect methods of reaching the 
results by iteration, or successive approximations.* llccently, 
Kelley and Salisbury have advanced another such method* which 
they claim will reduce the labor of computation in a sixteen-variable 
problem at least niuoty-dvc per cent over determinant methods. 
Tolley and Kaokicl have shown, however, llmt tho ICclloy-Suhsbury 
Iteration method in fiolving a six-variftblo problem for partial regression 
and multiple conelation coelBcicnts is far inferior to the Doolittle 
method.< Kelley grants the suiicnority of tho Doolittle method 
“for a small number of variables—perhaps up to 10,” and recommends 
Its use; but lie insists that tho recent improvements on his iteration 
method make it tho swifter instrument where a great number of vari¬ 
ables are involved.* 


The Doolittle Method 

Tlio Doollttlo method is a variation of Gauss’s direct method 
of solving simultaneous linear equations by substitution. Gauss 


' Carr, G. S • *'A Synopsis of Elomonlary Results m Pure Mntliomatics.” 
Francis Hodgson, London, 1880, pp. 42lf. 

* Kollcy, T. L.; “Statistical Method.” Pp. 302-310. 

Whittaker and Robison: Op. aLt pp. 8561T. 

Edgeworth, P. Y.: A Now Mstliod ef Reducing Observationa Relating to 
Several Quantities. Phxloioplucal Mq/qoivm Scr 6, Vol. XXIV, pp. 222-223, 
405-479; Vol. XXV, 1888, pp. 184-191. 

Ford, L R.: The Solution of Equations by the Method of Sucoossivo Approxi- 
matvons. American Afat/icmahcat Monthly, Vol. XXXII, 1925, pp 272-287. 

* Kelley, T, L and Salisbury, P, S : Iteration Method for Determining Multi¬ 
ple Correlation Constants. AiMncan Staljstieal Asaocialion, Vol XXI, 1920, pp. 
282-292. 

Salisbury, F S,: “A Simplified Method of Computing Multiple Conelation 
Constants. Journal of Bducaltotial Payehology, Vol. XX, 1920, pp. 44-62. An 
Improvement on tho iteration method cncplamod in tho procoding article. 

^ Tolloy, H. R and Ezokiol, M. M. B ‘Tho Doolittle Mothod for Solving Multi¬ 
ple Correlation Equations va. the Eolloy-Salisbury Iteration Method. American 
Sialialical AaaoclaUon, Vol. XXII, 1927, pp. 407-500, 

* Kelley, T. L. and MoNomar, Q.: Doolitllo vs tho Kolloy-Snliahury Itonition 
Mothod for Computing Multiple llogrosaion Coofiicionts American Statistical 
Assooiolion, Vol XXIV, 1029, pp. 104-100. 



Partial Corralali&n Vi. ParUal Regreanon 43 

developed sovoml inelhoda of solution—some direct, others indirect.^ 
M. H. DoolitUo of the United Blalos Coast and Geodetic Survey made 
various improvemonlB on Gauss's method of direct subsjjitution, and 
in 1878 published an account of his method.* Doolittle's method 
replaced Schott's version of Gauss’s approximation method In the work 
of the coast and goodelic survey,* and found favor among engineers.* 
In 1923, Howard H. Tolley and Mordeeai M. B. ICxekiol of the United 
States Bureau of Agricultural Kconomics introduced this method for 
the solution of the partial regression coeiHclcnts (KeLloy’s /S's) Into 
statistical practice,® in which the writers adopted the novel method 
of using the mean product sum, poi =■ ^n/N, etc., in the simultaneous 
linear equations, instead of the zero-order coefficients as is the general 
practice. Mills adopted tho method os there presented for his text 
on Gconomlo and business staiisllos published tho following year.® 
Hull also uses tho entire method as outlined by Tolley and Ezekiel in 
his 1928 book, "Aptitude Testing,"* In 1925 Wallace and Snedecor 

‘ For Bomo of Gnusa'a molltoda bqc, Mcrrimnn' Op. cil, olgluh oclition Fp. 
181-187. 

Wlillluker and Kabjnson: Op. eU., pp, 284-230, 267-203. 

Enoko, J. F.: Uobor die Mothodo dor Kiolnslon Quadrate. Astronomische 
Jahrlnich, Ilerlin, 1830, pp. 207-272; 1886, p. 206 Gouas’s direct prooosa for 
soUilion by elimUialion. 

Jacobi, K.\ “AstronoriiUcho Naehriahton," Altona, No. 023, 1845, p. 297. 
iQausa'a incUvod of sueocaaivo npproxintalions. 

Sohott, C. A,! Fkilutlon of Normal Equations by Xndiroot Elimination, 
Coast Survep iioport, 1866, pp. 266-204. Oau^'a mdiroot process of elimination by 
suGCOsaivo trinls and approximnlions revised and aystcm&tir.ed for use m tho coast 
'survey. This method was largely used (rhore for twenty-five years until replaced 
by tho Doolittle method 

* Doolittle, M. II.: Method Einployod m the Solution of Normal Equations 
and tho Adjustment of a Trlaiigulation. Coast and Gcodelio Snrvey Report, 1870, 
pp,115-120 

’Sob, Wright, T W. and Ilayford, J. P* “Adjustment of Obsoivations by 
Methods of Lenat Squares,” aocond edition D Van Nostrnnd Co , New York, 
1006, i)rofaco 

Also, Adams, 0 S ’ Application of tho Theory of Least Squares Special 
Fublication No 28. Coast and Oeodelie Survey, 191B. 

* Loland, 0. M.: "Prnotical Least Squaios,” first edition McGraw-Hill Book 
Co., Now York, 1021. 

' Tolley, II. 11. and Ezckiol, M. M. B.: A Method of Handling Multiple Corre¬ 
lation Problems. American Slattstical Assoeiationf Vol. XVIII, 1923, pp 993- 
'1003. 

« Mills: Op cH , pp. dtlllT., 570-581. 

* Hull, 0 L.. “ApLitudo TcatiuK,” Hist edition. World Book Co , 1928 



44 


The Journal of Eduraltonal PfnjrJwlngtj 


used the motliod, but with zcRHordcr coefficient itiafoad of mean pro¬ 
duct sums, in their little manual for apicuUural rcaoarch workers.* 
Garrett, 1928, saw that zero-order coefliciwils could be fiubHlituted for 
the mean product suins, but he evidently was unfniniliiir willi tVallace 
and Snedecor’a study, and ho also aceiiii to have failed to invealigatc 
ToUoy and Ezokiel’a reference to the Doohllle jnctliod of Holuiion.^ 
The writer would recomtnenci Wallace and Snrdeeor’H sludy to educa¬ 
tional psychologists as llic olean'Ht and moat ariequale prertcnUilion 
of tho DoaUttlc method now avaiUdile* 


CuNOumiOK 

Thds wo have seen that the meUiotlH for obtaining I hi* regrcRsion 
equnjWons and tho cocfllcient of iiiultiplo currelalion were hampered 
foji^any years by inadequate and cumbersome inclliotls of solution, 
^ow that a synthesis of the most econumicnl slaliHiicnl nieilind for 
obtaining the regrosaion cqualionH, ilie purlinl regression melluul, has 
been effected with tho moat ccnnomical engineerinK method for 
solving simultaneous linear equations, the DooliLle method, we may 
expect that the multiple corrclalion and piechclion lechnniue will bo 
employed to a much greater extent in educalional psychology limn in 
tho past, 


* Wallace, II. A and .Sncdccor, (5 W.. “CorrelMtion and Madmn* (Jnli iilnlion " 
Olhcial publication, Vol. XXIII, No. 35, lowo Nialf <V>ll<‘g(> of ARriniUure, HI25. 

* Garrett, II. B : A Modificnlion of Tolley and Kyckud'a Mrllmtl nf Ilatidlmg 
Multiple Correlation Prolilonis. Journal of Eduf^Uwmil r^yehi>h>g\u Vol. MX, 
1028, pp, 45-d9. 



TIIK SUjtllKKACiE OF THE (T)KmCTENT OF 
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ski»mi;r c. lajihon 

(’nrMon Nnrlh(i<>ld, i^[innpM)lo 


iNTItOnVf tION 

It haa IxTii rc-pn^^iiiaiMl by Ihc'iiroUcal stiiliBticiatiB for some time 
that wljon ll»t* cooffieienf iiiuliipk* corrdntioii (R) is derived for a 
given set of dutii, its viilue is likely lo Iw cleceptivoly Inrgo, If the 
eorapuliitioHH lisivc correct, the value will hold rigidly for the sot 
of diiln from wliicli the rcRrcKsiuii cquatiou wna dorivod If, however, 
the equation sin add i>e siiipHed lo a secoud sot of data, oven though 
strictly coinpamhle, it han l>een aupposecl that the yield in tins latter 
ense would, except for errors due lo Bampling, he less than In the first. 
Moreover, it has lieen Huppoaetl llml Uie more variables contained 
ill tlio rcgrcHsion ciiuatioii, the grealer IhiB elirinkagc will be. This is 
particularly Kigiiificanl becuuBC ordiiianly the praclical employment 
of a rcgrcRsion eiiualinii involves ila use with data other than those 
from which it wim derived. If lhi« ahnnkage should turn out to be 
very large, Uie Iniilding nf ntulUpIo regression equations iniglit well be 
abandoned, Tiu* matter i« therefore one of considerable importance, 
both tlicoreUcnlly and praetiftally. Huvcral attempts have been made 
by statiBUcimiK lo derive a formula whiclt should indicate the amount 
of lliiB Hhrinkage. I'lu' nuwt proniiBing one of llieso will be considered 
in Die present paper. iSo far as the writer has boon able lo dz.SG0VGr, 
no one Ims attempted to delorminc expeiuncutally the actual amount 
of Blu'inkiigi'. Tile present icport deaonbes such nn attempt in the 
field of psychological te.sling. 

A study of the slinnkago is made by using a regression equation 
derived from one group of BUbjecls lo predict the criterion scores of a 
scconil group. The eoueUilioii yield by tins proceduie is subtracted 
from tlie yield oblaini'd by predicting the ciilerion scores of the second 
group by ineaiiH of a legrea-sion equation deiivcd from Ihemselves. 
TinaBlirinkagi! is Hludied wllli the miinbor of the indopendoiit variables 
in the regiesHum equaUoii ranging from one lo ten in number and for a 
variety of diffeumt ciiteria. A coiiiparlson is tlien made between 

* Fiom tlic P«y‘'ln>l"KU‘iil LHl)Oiiil<ir\, IfiHvciwly of Wisconain. The writer is 
greatlv imlehttMl lo PiofrKHor M. V O'Shea foi peimi'Mioa to use data aeioctecl fiom 
the results obliunetl hv ll»e MwsiSHippi Survey 
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such empirical findings and the lesults obtained by applying a recently 
proposed formula for detenmning the same type of shrl^nkage.^ 

Source and Sbuection op Data 

Something like 30,000-pupils were given mental and ajchiovement 
tests m a survey of the school system of the Stale of Mississippi 
For the present study, the test scores of eight hundred 'high school 
pupils from this number were used The semes of pupils fiojm the large 
and medium-sized high schools were chosen m the belief th^at the level 
of instiuction would be more nearly umfoim ® The ontii'c; population 
of eight hundred consisted of four groups—two hundred boys in each 
of two groups and two hundred gals in each of the two leraainiiig 
groups. The subjects to make up these groups woie chosen from those 
tested by the survey in such a way that each of the four contained 
exactly the same numbei of individuals diawn fiopi any particular 
class of each school sampled. Otheiwise the placing of the subjects 
in the several groups was entirely at landom By making up the 
personnel of the gioups in this manner it was felt that they would be 
as exactly comparable in regard to general level and range of natural 
endowment, culture, and educational ooportuniiios as possible. 

Each pupil had eighteen scores enteicd aftoi his name, The 
designations aie as follows. 


Eaglisk 

Xa Mathfematics 
Xa Science 
Xi Iliatoiy 
Xs Chi onological ago 
X« Intelligence quotient 
Xj Information (Teiman) 

Xs Best answci (Torraan) 

Xi Word meaning (Toiman) 


Xm Logical fcelcctiorvs (Tcimtvu) 
Xu Aiitlimetic (Toiman) 

Xi» Sentence meaning (Toimnn) 
Xit Analogies (Toiman) 

Xu Mixed sentences (Teinmn) 
Xif Classifications (Tcrinnn) 

Xu Number S011C3 (Toininn) 

Xu Total Teiman 
Xi8 Total Iowa 


The first four X's together with Xia aie scoics made on the Iowa 
High School Content Examination. X^toX^ arc scores made on the 
Terman Group Test of Menial Ability Another column—the sum 
of each row—was added for checkmg puiposGS 

'Ezekiel, M. J B. An unpubbshed paper read bofovo the Mathoinatical Society 
at its annual meeting m Chicago in December, 1028 

* O'Shea's study showed that for the state as a wholo scholastic acliicvement in 
the small high schools was decidedly lower than iii the laigei ones. 
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Pakt I 

Ten distinct icgipssion rquationa with lOnghsli as the oritorion 
were derived from ilie data for the first Kio«P of boys. Ten parallel 
rcgicssion equations wore derived from the data for the second group 
of boys. In tlic case of the first group^ tlic first equation had all 
ten independent varialilos (tosls) The second equation had the best 
nine test variables, i.c,, those having the liigliest criterion correlations. 
The third liad the beat eight test vaiiabics, and so on down to the tenth 
equation which was based on the single test having the highest oritorion 
correlation. Tlic same piocedure was followed with the second group 
of boys, except that in tida case the same test variables wore used m 
the corresponding equations ns were used with the first group. Owing 
to a natural vaiiability in the size of the zero older correlation coeffi¬ 
cients from sample to siimiile, the tests successively excluded from the 
progressively smallor equations with the second group of boys wore not 
m all eases the next in order of weakness in the criterion r’s 

Space IB lacking for the presentation eiLhei of the means and 
standard deviations ncodod for the derivation of tho regression equa- 


Tahlr I —ZuHO OnDmi Cokppiciknth op Coiiiibi.ation Pon Both Sets op Boys 

The Bold Taec Figuu's at the Uppoi Itight Aro the Cocflicicnts of Correlation 
for Boys, Set No 11; and Llie Light Lhcc Figuici nt the Lower Lclt Aro the Coefli- 
eienta for Boys, Set No I At the Top and Left of Table Aie Indicated tho Vaii- 
fiblcg Whoso Notations Aic Outlined Eailioi in tlio Text This Table Shows How 
English (A'l) Corrclatofl with Each of the Items in llio Tonnnn Test and Also tho 
Intcicoirolations between (lie Vaiiotis Items 
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lions or for the icRr(*‘'Hon ('(HUiliciH rln‘inc^‘I>cs > In t>i(l(‘i fiml llu* 

interested reader may Hludy lh»’ ndationMnp llic onpiml 

correlations and tlie Mivcial miillipN* corndatntn yicld*^, ihi'ic li-is hi-cn 
placet! m Table I dm eiiliie f-ern*^ nf '/n it urder nu k IhIkui cucHiciciils 
{or both groups of bojs. Tin* (’(icdirKMils of liio n'‘.pi'i'li\ v gmuph iiic 
distinguished by means of coiilrM^ling lyiir- fnei-,- Ail fif llic (oelh- 

cieiitsaicposilivo. 

TliomiiUiplc conelalinii cocnieieiiN ih'iivetl fniin I lie i csiill s shown 
in Table I are givmi in 'ral)le li. 'riie }i'h eoirc‘*|inii(liiip; iri i)io i-cv(*ral 
multiple regression (■(iimlions iloiivul fjfiin llo’ bov-^ of ftroiip I {in- 
shown in row A and tlio-io for (iioiip II iii lov. !> Tlie-t- vhIik-h an- 
the correlation cnelUcieiiN which would have hi'cii oblaiucil if m 
each case the test hcoie^' fioin wliieb (he i(‘gu“-‘’i«»ri cipiiilion was 
(Icrivctl had been subshuaed wi ilic cipiahon ibelf and 

the lesultiDg ciitenoii esliiimlcM liad heen eoricl.-itcil with llie fine 
criterion in the ordinary way Aeliially, iIich* Mdiics wi-ie obluinecl 
by menus of the iisutd fonnid.t wliwdi is decidedly siiiipliu Tim 
coefficients in bofh kclics ar<> distinclly liigli, as {ipitiiidr- coiK-hifmp 
yields urn. It ih iiolewtu thy, liowiwcr, that in lioth m-ucs jddn-, after 
three tests have bi-eii iiiclnd<>d in (he i‘(iiia(icm, (In- arldiiion itf idl (ho 
remaining seven tests sidliecH lo raise ihi- cnnclalioii yield a loial of 
barely a siiiglu point in (he sci oiid di'ciiua] placi-, 

Tho noHt Rlep in Ihe piin'c^s w.-is lo stih-<(iiuii^ (Ik- adiml lest 
scores of the boys of (iroip) I in ihc (-((iialioiis ili-iivcd fioin (hoiip [I 
nnd tocori'olalo lh(> icMulliiig ciiIcmom csrimalcs wiih (lx- inn- ciitcnoa 
scores of Group I Thu icsuUiog senes uf eoclhi ieut> is givi n m 'I'uldu 
II, row/? The pioceduie was (hen ii'\e!‘'cd 'I’lie liuc mlciioii 
ol Group II wan conclatcd willi (lie ciileiMin csiimsilcs ol)(iiined hy 
substituting tlieir lelevjinl (esi hemes in (he eiiu-dions ih-nved from 
the scores of Clioup I. The lesidling eiK-lheients lae given in low A'. 
We DOW have the vahu-H fiom vvhieh shiinUagi^ ma\ he delermincd. 

Accoiding to tho a pruni e\j)e(*(:ilioii fis ladiealeil above, the values 
in row B should show n peiei'ptihle hhnnhage^ wlieii eompaird with (he 
values in row A and siimhu Iv vv il hiovv A w Ih-m eoinpjued wilh law I). 
A brief comparison of tlu- A’ v {ilm-s m i h<- i vv(> p-oi s of lovv s show s l li;it, 
except for the eipialion ednljuniiig Inil a Miigle (esi vaiuilile, this 
expectation is leivUzed. 'I'lie .’inuiiinl of llie slinnhnge is hIiowji hi 

* These nro givi'ii in deliiil for the < n (in- fil ml \ m lln- mi Midi '« ili-- hm hit k in lilnl 
in lliolibiaiy of tlio IJiiiver/iitv' of Wim «iii‘.in U 11 • niillul "Miidii’^ m Vjitihidc 
^oreeaaUng vvilh Ihn Mnltiiih. Ue^ir^.iun TiimhIium " 
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row G for tbo several pairs of values of Group I, and for Group II 
in row F. The mean values for rows C and F are given m row <?. 
A glance at these latter values shows at once that, despite a certain 
amount of variability presumably due to sampling en’ors, there is a 
clear tendency for the shrinkage to increase with the increase in the 
number of independent (test) variables in the legression equation. 
This again is in harmony with what has been believed by statistical 
theorists. A graphic representation of the mean shrinkage values 
shown in row 6 is presented as the solid line in Tig. 1 



Fig. 


l.^ShPlttVaga M obtained by the use of the foraula 
and also as obtained esparlmenlally. 


We have seen that the increase in the size of P, even when regres¬ 
sion equations are applied to the same data from which they are 
derived, is extremely slight and grows less and less as the numboi of 
test variables increases We havo also seen that under the same 
condition the amount of shrinkage in yield fiom such equations when 
in actual use grows greater and gi'eater. The question naturally 
arises whether there may not be a pomt beyond which the increase in 
R resulting from the addition of a new test variable may not be more 
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than offset by the inoionso in shrinkage^ so that tlio tiuo functional 
value of such a lost liattoiy or othci oblimafcing aggregate may not bo 
actually less than if the Icsl or olhci independent variable had not 
been added. An o-'camination of rows B and E shows that in the 
case of both groups alike such a critical point is reached at the eighth 
test added. In both the ballenes would have given an absolutely 
higher forecasting yield with Iwo of Ike tests left out. The moral of this le 
that under some circuniRlancos the inclusion of certain tests m an 
aptitude battery after it has reached some su'/C may not only entail 
the waste of energy and materials of administeiing the test, but may 
actually reduce the yields and this even when the be.st possible method 
of weighting the tests is employed, 

Paht II 

To seouiQ fill thor empirical evidence as to the amount of shrinkage 
from the ordinary multiple coirclation coefficient, further computations 


Tabu III— Showino thu SmuNKAan of R'a When the Same (10) Test 
VA niAOLBs Aht: Uh>5d but Diffboent Acadbmio Sudjbcts Aiib 
Employed as Ciutbiua with Difpbhbnt ConnsLATioN Yields 




English 

Mathe¬ 

matics 

Science 

Ilistoiy 

Total 

Iowa 

Boys’ Group II, 

Conolation yield (iJ) fiom 
equations doiived from the 
subjeota' own scores 

1 

7800 

6431 

5689 

7719 

8200 

Correlation yield (R) from 
equations derived from the 
scores of Gioup I 

Ji 

1 

6148 

5230 

7605 

8008 

Shrinkage . 

C 


0283 

0459 

0214 


Girls’ Group II 

Correlation yield (JJ) fiom 
equations derived fiom the 
subjects’ own scoies 

D 

7089 

6403 

' 4548 

7115 

7875 

Correlation yield {R) fiom 
equations deiived fioin tho 
scores of Gioup I 

I 

■ 

6226 

4219 

0786 

7766 

Sh linkage 

F 

■ 

0177 

, 0329 

0329 



weie undertaken in all of which the number of test variables was kept 
constant. The number chosen was the maximum for this study 
ten The multiple regiession equations on mathematics, science, 
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history, eto , for the boys of Group I were used to estimate tlhe cofre- 
spondiug true oritoiioD scores of Group II The same proccJUire was 
followed for the gills i 

The results are given in Table HI which is constructed in al inannei 
Gompamble to Table II above With the number of test ■\|flriablcs 
constant, this table enables us to obaei ve the mfluenco upon the amount 
of shrinkage of the strength of the natural tendency to corrol [itiou m 
the test data involved. If we divide the ten shrinkages foinu I in this 
senes into two groups on the basis of the size of the oiigi nal It's, 
we find that the average shrinkage for the five largest R’s )i3 .0109 
whereas that for the five smallest fi’s la 0315. The tendencjl for the 
weaker sots of data to yield the laiger shrinkages is evident. ; For the 
two lowest values (Science) this amounts to .0394, a very ap (ireciablc 
amount * 

The Smith SHRii!?KAaE-DEDucTioN Formula 


A promising correction formula has been developed to apply 
to the coefficient of multiple correlation. A paper conlaimng the 
formula was read by M, J. B Ezekiel at the December 1928 meeting 
of the Ameiioan Mathematical Society held at Chioago. This 
formula is 


1 _ 
2^2 = 1 1 —iL or 

n 


n W^ ~ m 
n — VI 


where jR <=■ the estimated eorrolahon obtaining in the universe 
P the observed coirelation 

m = the niimber of variables, dependent and independent 
n s= the number of observations (statistical population) 

Ezekiel gives the credit for developing this formula to B. B. Smith, 

At the completion, of the computations described in the preceding 
section it was a relatively simple task to substitute in the above formula 
and determine for the various observed I?’s, the ooirespondmg esti¬ 
mates of the “correlation obtaining m the universe " These values 
are given in Table IV for the R'e obtained in Part I Table Y shows 
the corresponding values of the B’s obtained in Part II Subti action 
from the original R’s shown in Tables II and III respectively yields 
the amounts of shrinkage which would be anticipated by the foiinula 
in each case 

In Table lY low E shows the mean amount of shrinkage foi each 
pair of observed It values foi the several numbers of test vaiiablea, 
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It IS plotted in Fig. 1 for the paipose of easy comparison with the 
empirically deteimmod shrinkages. It is clear that the formula 
definitely parallels the empirical findings It conforms to the observed 
tendency for the amount of shiinicage to mciease with the number of 
variables involved m the equation There is a well-maikcd tendency, 
however, for the Smith foimula to indicate malei lally largei shrinkages 
than the empirical results show 

Passing to Table V, we may make the comparison with the empirical 
results by treating the shrinkages the game as those in Table III 


Table V— Showing the SHmNKAGB of R'& as Indicated hy the Smith 
Formula, WiiBaE the Number of Variables Is Constant hut the 
Size op the R '& Vary HaTmeu Widely 




English 

Mnlhc- 

matics 

SeiQiicc 

Ilistoiy 

Total 

Iowa 

Boys' Gioiip IL 

Gorioktion obtaining m the 
univciSG (K) as estimated by 
the Smith formula , 

1 

i 7727 

6150 

5330 

7563 

8094 

Shrinkage obtained by 8Ub-> 
Uftctmg low A abovG trom 
low A in Table III , . 

B 

i 

0142 

0275 

0350 

0166 

0106 

Girls' Gioup II, 

Coii'olation obtaining m the 
universe (K) ns estimated by 
the Smith formula 

C 

7843 

6132 

4005 

0916 

7730 

Slirinknge obtained by sub- 
tiacing low C above fiom 
low D in Table III 

D 

0148 

0271 

0543 

0199 

0145 


Computation shows that the mean slmnkage of the five largest 7^’s 
IS .0139 wheieas that for the five smallest is 0329 Heie again we 
observe, as in Table IV, that the shiuilcages yielded by the formula 
are materially larger than those found empinoally. An analysis of the 
formula reveals that the shrinkage increases as the size of the obtained 
R decreases. The formula wiU breaJc down, however, when m/n> 
as the values will then become imaginaiy In this situation, with m 
equal to 11 and n equal to 200, the formula will give imaginary values 
when the absolute values of B are less 235. 
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SliMMVU'i \Nr) c*n>f III rlON*' 

1 The prc-sci't (*.'*•< ‘•(fMWJt fluf ‘}(»- ji.'jIIv 

expectedshnnkaRi'ofas Uy Oi.- inulup!- <'-.rr. ^ 

IS a fuet. , „ 

2 Thcslmukago is fniuKl tinni'n'as«-nsilii’iiiitnli'’rt»i h Tv'iTjjoa - 

Increases. 

3 Thofilu'iakago irt ahj* nmiano a ‘ J h'- ") /. «!■» T' j-.- ^ 

4 TheSmilUalninkagr-»l»‘ihu'fiMn fnriu»il‘i itirill* 1 • s)! Mo i3‘ir\o 

empirical fimlingfl, but (luKc Rivivihu'^ v.ln<'lj -trr tn 

excess of those obtaini'd uii<lor fla- pn'i-oiiii al - 

5 Theciapiricnlly sliriiiknK«-uH’roas* *'M tti(b;iri<'' wiMi 

thcincrcasoin theniiniborof l(*sL vunalilr** !b'M f»iioiif ilo- lu"''* n^l' ly 
known scholastic aptitude (i*s(s acfiially hbows a l*<wpr iMrr'lMj'Ui 
yield with a crUenou wlnui fen (i>l iiiiiIh aro ii-eil ilnii uIimi rijd> 
eightaro employed. TIuk MiggoMn iluti baii«'ri«lo lri\‘‘^'jv 
definite limitations us to .‘•r/e 



THE INFLUENCE OF BLOOD BELATIONSHIP AND 
COMMON ENVIRONMENT ON MEASURED 
INTELLIGENCE 

VEENEa MAUTIN SIMS 

University of Alabama 

One of the favorite modes of attack used in the investigation of the 
relative influence of heredity and environment on intelligence as meas- 
uied "by the tests of today has been through a consideration of the 
resemblance of siblings (biolbers and sisteis) in the trait or traits 
measuied by these tests These studies aie numerous^ and have 
invariably shown a decided coii'elatlon between the intelligence of 
siblings Inteiestingly enough, this correlation coefficient is about 
the same as the coi relation found between the physical charactoristics 
(eye coloi, cephalic index, stature, etc) of siblings—appioximately 
60. However, this similarity between the physical and intellectual 
lesemblance of siblings does not neeessanly mean that the lelationship 
IB deteimined by the game causative factors The physical char¬ 
acteristics aie seemingly uninfluenced by environment, but the siblings 
aie ceitainly subjected to a common environment, and, until evidence 
IS produced that this is a negligible factor in the case of intelligence, 
the correlation has no significance In lecent years thia fallacy has 
been pointed out time and again. It but lemams to attempt the 
determination of the relative contributions of common environment 
and blood relationship to the coiielation which is found 

One of the most satisfactory appionches made to this problem 
that has come to the writer’s attention is contained in the Chicago 
study reported in the 1928 Year-book of the National Society for the 
Study of Education ^ In this study the coiielation between the 
mtelligence of siblings leared m the same home was compared with 
that of siblings who were separated before either child was six years 
of age Instead of the usual coirelation of 60 a coirelation of .32 ± 05 

^Foj caiefulsummaucHofmcstimpoitantoftlicse studies see Builcs, Bailiara 
A Suminaiy of Liteiature on the Deteinuners of the Intelligctico Quotient and the 
Educational Quotient, Tnfenly^sepenUi Yearbook of the Nalional Society for the 
Sttuly of Education,, 1028, Part H, Chap, XVI, pp 262-261 

*Fieoman, Ilolzmgoi, and Mitchell* The Influence of Enviionmonb upon 
Intolligcnco, School Achievement and Conduct of Foster Childicii, Twenty-seoenlh 
Yearbook of Ihe National Society for the Study of Educalion, 1928, Pait I, pp 128- 
135, 
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(by age paiiing) oi .25 ± 06 (by double entry pairing) waa found 
between the intelligence of one hundred Iwenty-flve pairs of siblings 
who had been separated for an average of seven years and four months 
and had an average ago of five yeai's and four months at the time of 
the sepaiation This seems to bo rather convincing evidence of a 
decided enviionmental influence. The chief weakness of the study 
lies in the fact that all the enviionmental influences have not been 
eliminated, since those siblings had for a peiiod of years been subjected 
to a common environment. The moie than five years spent in the 
same home probably accounted for a part of the correlation found. 
In fact, piesent day tendencies in psychological theoiy would seem 
to indicate that the most significant pciiod of their life had been 
spent in a similar environment From the data which they had at 
hand it was impossible to determine the extent of this influence. 

The study reported in this paper represents a different attack on the 
same general problem The procedure used here in the attempt to 
answer the question of the iclative influence upon intelligence of blood 
relationship and common enviionment was to compare the correlation 
between the intelligence of pairs of siblings from the same home with 
the conelation between pairs of unrelated children, the unrelated 
pans being equated with the sibling pans on the basis of age, school 
attended, and homo background The significance of the correlation 
between the intelligence of siblings can only be inteipioted in the light 
of information as to tlie con elation that would be found if the members 
of the pairs wcie unrelated Piesumably children paired at random 
would show no resemblance, but one cannot compaie paired siblings 
with random pairs and account for the differences in terms of inherit¬ 
ance. It is only when enviionmental influences arc equal that com- 
paiisons have meaning. In this study the attempt has been made 
to equate two sets of paired childien on the basis of enviionment, the 
members of each pair in one set having the same parents while m the 
other the members of a. pair have diffeient parents. To the extent 
that these conditions have been met, the diffeience in the degree of 
relationship between the members of the first set compared with the 
second set can be consideied as a mcasuie of the influence of common 
parentage. 

During the spring of 1927 the writer eoopeiated in the testing oi ah 
children found in Grades Y to XI in five school systems m Lincoln 
Parish, Louisiana Foui of these schools were eleven-grade con¬ 
solidated ruial schools, the fift(h system consisted of two elementaiy 
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schools and a high school located m a town of appioximately 6000 
population. The Otis Self-adminisloring Tests of Mental Ability 
■were used to measme intelligence, and the Sims Score Card for Socio¬ 
economic Status was used as a measure of homo background The 
Otis InlcnnediatG Test, Foim A, -was used for Grades V to YII, and 
the Higher Test, iForm A, for Grades VIII lo XI. On the basis of the 
scoies made on the Otis Tests the IQ’s were deteimined by the proce¬ 
dure lecomraeudcd by OUs in his ^'Manual of Diicctions.” The 
reliability of the Otis Tests, as reported by the author, is high (.96 
for the Intermediate Torm and .95i for the Higher Foim). The 
validity IS more difficult to deteimine, but high correlations reported 
between this test and other tests of intelligence would seem to indicate 
that lb is measuring approximately the same thing that all of our 
intelligence tests measure The reliability and validity of the Sima 
Score Card has been discussed at length elsewhere.'■ Suffice it to say 
hero that H has been shown to adequately diffeientiate between groups 
with known diffeiences m home environmont; and the reliability, as 
debcrmined by correlating the scores of childien from the same home, 
has been found to be rather high, approximately 90. The coefficient 
of reliability determined from one hundred, pairs of sixth-, seventh-, 
and eighth-grade children was 96, and the coefficient found by 
correlating the scores of the two hundred three pairs of siblings reported 
below was .87. The i datively low reliability of the data used here 
may be due to the fact that some of the examiners were not very 
skilled in testing, but there ia evidence that high school children 
ropoib a slightly higher socio-oconomic status, peihaps because 
certain of the items included in the scale are actually more frequently 
possessed by older children This increaso is, however, veiy slight, 
being less than one-third of a point a year, and, although it does 
lower the reliability of the measure, it is still leliable enough for our 
purposes. 

From the tested population desciibed above, each child repoiting a 
brother or sister living in the same home and enrolled in one of the 
schools and grades included in the testing (Grades V to XI) was selected 
and his record paired with that of tho brother or sister reported. 
These siblings were paired in aU possible -ways, that is, where three 
siblings were tested they were grouped A "with B, A with C, and B 


^“Tho Meftsuremont of Socio-Economic Statua.** Public School Publishing 
Co, 1928 
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witli C. More than three siblings wore not reported m any case. 
This pairing seems to be the generally accepted one when the number 
of siblings found in any one family is not large Two hundred twenty- 
four such pairs, coming from one bundled cighty-iwo homes, were 
secured, but for leasons explained later, twenty-one of those pairs weie 
discarded, so that two hundred three pans from one hundicd sixty-one 
homes composed the mnm group used in this study. 

The unrelated pairs were prepaied by substituting for one member 
of each sibling pair an unrelated child coming from the same school, 
and having the same age and home background. The procedure for 
piepaiing one of these unrelated pairs was as follows. Uoferring to 
the school where the younger sibling was enrolled, that child with the 
same home background score and most nearly the same age as the 
younger sibling was selected. When two or more childien were found 
to fulfill those requirements to the same extent, one was chosen at 
random from the number. In the same manner the child most nearly 
a duplicate of the oldei sibling was selected The one of these two 
selected children nearer the ago of the sibling which he was selected 
to duplicate was taken as one member of the unrelated pair and the 
other sibling as the second member. In no case was a child selected 
whose age was not s^viihin one year of the sibling and whose home 
background score was not within one point of the sibling's score, or 
the average of the siblings' scores in cases where there was a difference 
m the reported home background score of two siblings If no such 
child could be found, the sibhng pair was discarded, The twenty-one 
pairs of siblings mentioned above as being eliminated from the study 
were discarded because no unrelated pair could be found to match 
them 

In this manner a group of two hundred three pairs of unielated 
children having the same age and home background and coming 
from the same school as the sibling pairs were secured ‘Within the 
reliability of the measures used they differ fiom the sibling pairs only 
m the absence of common parentage. Table I presents the average 
age and socio-economio status (with the standard deviation) of the 
two groups, the young membeis of the pairs being contrasted with the 
old membera In addition, although it is to be noted that they have 
not been paired on these bases, the mean grade and IQ (with the 
standard deviation) le reported, 

That the groups used here are fairly representative of the popula¬ 
tion from which they wore selected is shown by comparing the averages 
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and sigmas for intelligence and socio-economic status of the siblings 
and unrelated pairs with the total population. The total population 
tested consisted of 1018 cases and the average IQ was 90.9 (with a 
standard, deviation of 15.6), while the average sooio-eoonomio status 
was 14 7 (with a standard deviation of 5 9) 


Taulb I,—Showing the Mean Aqs, Sogio-egonomic Status, Guadr and IQ or 

THE SidLINO PAinS AMD THD UN11BI.ATED PaIUS 




Age 

S-E-S 

Ginde 

IQ 

Mean 

Sigma 

Mean 




Mean 

Sigma 

Young member 






M 

M 



Sibling 


EG 

2 0 

12 4 

5 4 

Ma 

HI 

01 8 

15 4 

Umelated, 


m 

1 9 

m 

6 4 


B 

91 3 

14 7 

Old membei 







B 



Sibling 

203 

16 9 

2 1 

13 4 

5 6 

9 1 


87 3 

13 6 

Unrelated 



2 2 

13 5 

5 4 

9 1 

B 

87 5 

13 3 

Difference between old 










nncl young 










Sibling 


2 9 

. 

■E 


1,9 


4 6 


Umelated 

■ 

m 


6 


1.8 

B 

3 8 



Compaiison of the sibling and umelated groups shows then great 
Bimilanty. The differences between the members of the sibling pans 
(young against old) is seen to be practically the same as the differences 
between the members of the unrelated pairs The average diffeience 
in age is approximately thi-ce yeoi's, and in giade approximately two 
grades; the old members score slightly higher on socio-economic 
status; and the younger mcmbeis have the higher IQ One is struck 
by the fact that, although no attempt has been made to equate the 
groups on the basis of either gi*ade or intelhgence, theie appears to be 
just as much similarity between the two groups on these measures as 
on the other two * 

Certain factors may independently affect the intelligence of mem¬ 
bers of pans such as those here used; consequently the degree of 
correlation found between the ptuied cases is influenced by the method 
used foi entry in the correlation table. Because theie is yet some 
doubt as to what is the most satisfactoiy method, in the correlations 
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reported hero two mctliocls were used. By the first (known hereafter 
as the nge-painng method) the score of the young member was always 
enteied on the veiticul axis of the correlation table and the scoie for 
the coriesponding old incmbei on the horizontal axis. By the seoond 
(known as the doublc-ontry method) each jiair of scores was entered 
twice, witli the youiiK on Iho vertical axis and then with the old on the 
vertical axis.^ 

The correlation botweeu the iQ'a of the siblings and the correla¬ 
tion between the IQ’s of the unrelated pans, using the two methods, 
are as follows; 

r (Aoe PAiniNo) r (Dotjdi.e EnthtJ 

Siblings (A^ = 203) 44 + 04 40 + 04 

Unrelated (A^ = 203) 35 ± 04 20 ± 04 

On the surface, at least, it seems that these correlations, between 
the intelligence of the members of the sibling pairs and between the 
intelligence of t\io unrelated pairs, should be indications of the rela¬ 
tive influence of common enoirommrd plus coinmon parentage, and of 
commo7i envi7'oiiment only on intelligence as measured by a group test, 
that 18 , common environment pioduces a coirelation of 35 or .29 
depending upon the method used, while the addition of common 
parentage raises this correlation to .44 or .40 again depending upon 
the method used The writer is inclined to believe that these are 
the most significant coriclations reported, but theie are undoubtedly 
certain factors which might influence these coefficients that make it 
undesirable to accept them at face value. It has been pointed out by 
numerous investigatois that there is a decided relationship between 
age and intelligence, consequently the coefficients for the members 
of each group is being thus affected. For compaiative purposes, since 
the ago factor is presumably operating the same in both cases, it is 
peihaps of small matter; but it seemed desnable to see what the coiiela- 
tion would become when age is kept constant. Partial oorielations 
with ago constant weio determined foi the sibling pairs and for the 
unrelated pans. In determining these coiiclations the age pairing 
method was used. These corielalions were, for the sibling pairs 48, 
and for the unrelated pairs .34 In other words, this coirection for age 


* In using theso two mcthotla wc oro following Uio piocccluro of Fiecinanj 
irohingcr, and MitohoU in tho study mentioned above 
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has not seriously affected the relation between the coefficients for 
siblings and for unrelated pairs 

It will be recalled that two forms of the Otis tests were used for 
testing the intelligence of the subjects Otis reports a covielation of 
only 84 between the two forms, consequently IQ’s detonnmed from 
different forma are not exactly comparable. In order to determine the 
inftuence which the use of two forma might be having on the correla¬ 
tions found, those pairs where the child subsiilutod to make an unre¬ 
lated pair was not tested with the same foim as was the sibling for 
which he was substituted were first eliminated ' Coefficients of 
correlation were then determined for; (1) those cases wheio both 
members of the pair were tested with the intermediate form, (2) 


Table II —Comi’auison of the ConnuLATiON between Intelugbnob of 
Siblings witii Unublated When the Same Form Was Useid 



r (A<3B PajiukoJ 

r (DouhlbEnthy) 

Intormodiato foim 

Siblings (A^ « 64) 

40 ± 06 • 

40 ± 08 

Unrolatod {N - 04) 

37 ± 07 

32 ± 08 

Higher form ‘ 

Siblings (iV • 66) , 

56 ± 00 

48 ± 07 

Unrelated (N » 66) 

43 ± 07 

30 ± 08 

Both forms* 

Siblings * 69) 

45 ± 07 

41 ± 07 

Unrelated {iV * 66) 

'31 ± 08 

31 ± 08 

Composite. 

Siblings {N = 176) 

61 ± 04 

49 i 04 

Unrelated (N = 175) 

30 ± 04 

37 ± 04 


those cases where both members of the pair were tested with the 
higher form; (3) those cases where the young member was tested with 
the intermediate form and the old member with the higher foim, 
and (4) the composite of all oases. The correlations between the 
intelligence of siblings are compaicd with those between the uni elated 
pairs in Table II Considering the composite of these cases it will be 


Since an ■unrelated pair was made by substituting that child in fciio school who 
had most nearly the same homo background and age, but not neccssaiily the same 
ffrade, as the sibling, it somotimca happened that the substituted oliilcl had boon 
tested with a different form fiom that used on the sibling 
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noted that although the coirclalions have been raised slightly there is 
no serious change in the latio of the unrelated to the sibling. Compar¬ 
ing the correlation found when the members of a pair were tested by 
the same form with Hint found when the members of a pair were 
tested ono by one foim, and the second by the other, we see 
evidence tliat the use of two foiins is probably reducing the correla¬ 
tion, but wc also see that the siblings and unrelated are reduced to the 
same extent 

A final factor that needs to be taken into consideiation m the 
interpretation of the cooflicientB that have been found in this study 
18 that of selection What would be the effect on the correlation found 
if wc had available all of the hrothcis and sisters of the siblings used? 
Wliat would be the effect if wc had all of the children in the community, 
or even in these scliools, who were of an age and from such homes as 
to make them suitable for use m the picparation of our unrelated pairs? 
We have made an attempt to answer these questions. Presumably 
pairs with ago differences such as those of the cases used here made 
up at random would show no coirelation between intelligence. As a 
check on the validity of the method of paiimg used here—m order to 
SCO if it operated in such a way as to select pairs with like intelligence 
independent of tlic factors which wo have assumed to be causing the 
similarity—a third set of paired coses was piepared. These paired 
cases were made by selecting for each sibling that child, in the same 
school (and in the grades included in the study) having most nearly 
the same age as the Ribling. When the neaiest age was found to be 
represented by several ehildicn, one was selected at random A 
duplicate for each sibling pair was then scoured by taking the selected 
child neaior in age to the sibling he was selected to duplicate as one 
member, and the other sibling as the second member In this manner 
a set of two hundiod thice pans of unrelated childien having the same 
age and coming fiom the same school as the siblings was piepared. 
Since they have been paned without icgard to either blood lelationship 
or like home background, the coiTcIetion should be zeio. The correla¬ 
tion actually found, by age and by double entry-paiiing lespectively, 
was 06 ± 05, and .04 ± .06 It appears that whatever selection is 
operating is very slight, and it is presumably affecting the siblings 
and the uni elated in the same way. 

To summarize, then, siblings leared in the same home have been 
found to have a coiTcIation of approximately 45 between their intelli¬ 
gence quotients as determined by a gioup test, while unrelated pairs 
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equated with the sibling pans on the basis of ago and homo backgioiind, 
and attending the same school as the siblings, have shown a correlation 
between their IQ’s of something in the neighborhood of 30. 

Attention should be called to the fact that the crudeness of our 
measure of home backgiound is operating in such a way as to increase 
the difference between these two coriclations The siblings have been 
reaied m the same hoviCt and to the extent that this moans common 
environment we ai e sure they have it The imrolalcd pans have been 
reared in different homes, but homes we have assumed to be alike 
because they had the same score on the scoie caich To assume that 
two children have the same home bnckgi’ound because they have 
the same seoie on this scale is unreliable to the extent that the measure 
15 unreliable, but to coreipaio children equated on this basis with 
childien actually leared m the same home has an added factor of 
unreliability caused by the failure of the score card to measure all 
of the finer environmental differences found among homes that are 
seemingly equal The eoeffieient for the siblings is not subjected 
to this factor, which is almost sure to attenuate the coirolation for 
the unrelated pairs. In other words, if we could find unrelated pairs 
that had actually been maied from birth m the same home wc would 
expect a correlation between unrelated pairs that would more nearly 
approach that found for siblings One feels sure that the influence of 
blood relationship on the intelligence of siblings is not being under¬ 
estimated when the difference between the coefficient found hero for 
the siblings and for the unrelated pairs is taken as its measure. Since 
unrelated childien who, within the reliability of our measures, have 
been equated with siblings show tbe resemblance that we have found, 
it seems safe to say that the common environment to which the 
siblings aie subjected accounts for a correlation between their IQ’s 
of at least ,30, while blood relationship is potent enough to raise this 
coefficient to .45 

In conclusion wo should call attention to the fact that throughout 
this paper we have been considering intelligence as measured by a 
group test The fact that high correlations have been found between 
various group tests of mtelhgence, and between gioup tests and 
individual tests, would lead one to behove that similar results would 
be found whatevei the test used This, however, does not wairant 
the assumption that there is not some quality in the human, some 
native capacity, which is inherited. The icsults may be interpreted 
as a condemnation of present day ‘inteUigoncc' tests 01 as evidence 
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lh 4 t intelligence is not solely inhorilcd, but rntlier a develonment 
to the interplay ol eiiviroiimentnl forces on hereditary charaoteiistir 
The interpretation that one may give, (he findings is a personal matter 
but the indications are that inlolhgoiice, so far as wo are today able 
to incafluro it, ia gicatly innuoncod by cnvironinoiit. 



THE EQUIVALENCE OF JUDGMENTS TO TEST ITEMS 
IN THE SENSE OF THE SPEARMAN-BROWN 
FOaMULAi 

H. H REMMESS 
Piiidiie UmveiBity 
The Phoblem 

A previous study by two of my students and myself® reported an 
investigation in which a summary of the experimental literature indi¬ 
cated that “the Spearman-Brown prediction formula shows it to give 
meaningful prediction on such materials as mental test items, spelling 
words, [judgments of] lifted weights, true-false items in language, and 
component units of rating scales." This previous work was done by 
a number of different authors—Kelley, Holzinger, Clayton, Ruoh, 
Ackeraon, Jackson, and Furfey. 

Our own experiment at that tune reported results on the Purdue 
Personnel Rating Scale which indieated that summations of ratings on 
ten different traits fell withm the limits of allowable error when the 
values of empirically observed correlations for varying numbers of 
raters were compared with those predicted by the Spearman-Brown 
formula That is, the formula did predict with reasonable accuracy 
the reliabilities to be expected with on increase in the number of judges 
or raters 

The typical situations m which judgments or ratings arc obtained 
is frequently limited by the fact that, assuming the Spearman-Brown 
formula to apply, the number of judges is too small to give ratings 
sufficiently reliable for practical purposes 

The piGsent study is the report of an investigation of the Purdue 
Rating Scale for Instructors m which the liinilatioii just mentioned is 
largely absent, since the average instructor is likely to have a hundred 
or more students On this scale students judge instructors anony¬ 
mously by checking on a gi'aphic scale the amount of ten different 
traits presumably related to success in classroom teaching possessed 

' A paper given before Seofcion I of the AmoTican Associatioti for tho Advance¬ 
ment of Science, Doc 28,1929, Dea Momea, la, 

* Remmers, II H,, Shook, N. W., and Kelly, E. L An Empiiical Study of the 
Validity of the Spearmaa-Browu Prophecy Foimula as Applied to the Purdue 
Bating Scale Journal of Educational Payehidogyf Vol XVIII, No. 3, Morch, 1927, 
pp. 187-196 
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by a given teacher undei consideration. In a rating program earned 
out at Purdue University during 1928-1929, something over ninety 
per cent of the faculty weie laied ^ A number of instructors turned 
over to me their maiked and scored laling blanks The question the 
answer to which was sought was, Do the judgments which students 
recoid conceinmg their instructors follow the law represented by the 
Spearman-Brown prophecy foi-mula? In other words, is it valid to 
assume that judgments are the equivalent of test items m the sense 
required by the formula? 

The formula, by now rather well known in its application to test 
construction, is 

_ writ 

14- (w — 

where r„ = the predicted reliability, 

n = the number of times a test ia increased by its own length, 
and 

rii = the reliability of a unit length of the given test. 

In the present problem the unit is the judgment of a single student, 
and the problem is to determine the correspondence of reliability 
coeflicienta determined for given numbers of such judgments with 
those predicted by the formula. 

If the conditions of the formula weie always fully met, perfect 
piediction would result Piactically, howevei, the conditions are 
never ideally met, and our problem becomes a sampling problem sub¬ 
ject to the laws of probability 

It should be leoalled that the validity of the foimula depends upon 
the homogeneity of the test items, or, statistically speaking, upon the 
equality of intercoirelations between units and upon the equality of 
the standard deviations of these units 

Pbocedubb 

In the latings of the instructors used for this investigation there 
was, so far as I know, no selective factor operating m the return of 
these blanks, except that instructois with unusually low latings might 
have hesitated to retuin them as readily as those with more satisfactory 
ratings To the extent that such a factor did operate it would tend 
to reduce the variability of the total distribution of latings and thus 
to reduce the reliabilities below what they would otherwise have been 

* Rommeia, H H : The College Piofessor as the Student Sees Him BulUlxn 
of Purdue Uiuveiaity, Studies m Highei Education, Vol XI, March, 1929, p 83 
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From each instructor’s ratings scores "were selected according to the 
following schema: 

20 aamplingB of 1 t i 1 rntiag for trait £t PrcBcntation of Subjcot-ninttcr 
6 eampllngs of £ 6 ratings t>c. ^ 6 TfitlngSi for trait 6, Presentation of Subjoot-mattcr 
6 BamplIngB of ZlO ratings va ziO rolmga, for trait 5i PresentatSon of Subjoot-mattor 
5 BampliDSB of £lfi ratings es, Z16 ratings, for trait 6, PrcBontation of Subjcot-mattor 
1 Bomplmg of £20 ratings vs Z2Q ratings, foT trait 5, PrcBcntatlon of Sub)C6t-mnttcr 
1 BBinpling of £30 ratings vs Z30 ratingB, for troit 5, Prcaontotlon of Subjoot-mattcr 

Traits 1 and 10, Interest in Subject-matter and Stimulating Intel¬ 
lectual Curiosity, and also the sums of all traits, were sampled m 
exactly the same way, except that only ten 1 ps. 1 correlations were 
calculated for these, and that in the case of the sums of all traits the 
samplings obtained included only 1 pa 1, S20 vs. S20, and 230 oa. 230, 

The results of the samplings are shown in Tables I to VII. 

The Data 


Table I—DisTiuntmoN^ of Gourelations 1 us, 1 Rating for tub Traits 

Indicated 


™ Suma of all 

Trait 6 Trait lO . . 

tiaits 



Trait 1 

Trait 6 

Trait 10 


4 


1 

3 

2 

1 

5 

3 

5 

3 

2 

. 

3 

1 

1 

2 

1 

1 


1 

1 



10 

20 

10 

200 

420 

364 

314 

450 

363 

37 

37 

37 


Total 

Moan 

Modmn 

N* 


’* iV m all tables refers to the number of instructoi« 



In Table VII are summarized the necessary data for answering the 
pioblem raised at the outset of this study, t.e , as to whether judgments 
under the defined conditions arc equivalent to test items in tho sense 
of the Spearman-Brown formula The answer is that they aie. 
There is apparently a slight tendency for the formula to overpreclict, 
there being sixteen overpredictions out of a possible seventeen. These 
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apparent overpredictiona, however, are probably to be explained by the 
reduction in the number of instructors necessitated by the lack of 
instructors with very large classes This tended to reduce the “range 
of talent, ” with a cori’cspondmg reduction in reliability. In no single 


Table II— Correlations of 2J6 vs 25 Rattnos pou the Traits Indicated 


Trait 1 1 

Tiait 6 

Trait 10 


8G3 

783 

616 


700 

782 

676 


762 

1 700 

433 


721 

700 

428 


706 

644 1 

346 

Mcfln 

728 

736 

479 

Median 

752 

760 

433 

N 

36 

36 

36 


Table III,—ConnBLATiONS op SIO tw 210 Ratings for the Traits Indicated 


Trait 1 

Tiait 6 

Trait 10 


843 

800 

861 


.832 

866 

781 


663 

.866 

764 


662 

843 

681 


696 

782 

630 

■1 


846 

1 .717 



866 

.754 

N 


20 

' 20 


Table IV —Correlations of 216 vs 216 Ratings for the Traits Indicated 


Trait 1 

Trait 6 i 

Tiait 10 

961 

973 

902 

882 

064 

876 

702 

931 

872 

621 

004 

821 

007 

671 

1 791 

Mean 761 

887 

852 

Median 702 

931 

872 

N 7 

1 

7 
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Taulb V —OoRnEi.ATioNS OK S20 t«. 220 Ratinob foh the TnAiTa Indicated 


Trait 1 

Tiftit 6 

Tioit 10 

Sum oC all tiaits 

.801 

877 

036 

898 

N 13 

13 

13 

40 

1 

Taddb 'Vi.— CorreDations of 230 i>s. 

230 Ratinob for tub Traits Indicated 

Trait 1 


Trait 10 

Sum of all traits 

936 

876 

805 

872 

N 10 

10 

10 

10 


case, however, is the difference between the “best” or most probable of 
the observed eorrelations and that of the corresponding predicted 
values clearly statistically significant In the case of only two 
correlations is the diffei once divided by its probable eri or greater than 
two 

On the face of the data, it seems surprising that the summation of 
all traits should give no higher reliability than was observed This, 
however, is probably to be explained by the fact that the law trait 
scores are incommensurable Had these scores been fiisfc reduced to 
standard measures or pci’centile equivalents, the resulting reliabilities 
would very probably have been increased very mateiially. 

Summary and Conclusions 

Samplings of judgments for varying numbers of judges selected at 
random yielded reliability correlations within the allowable error when 
the judges arc undergraduate students and the things judged are 
classroom personality traits of instructors who are appieciably different 
in that they possess, in the judgments of students, different amounts 
of these traits. The number of coirelations upon which this study 
was based is one hundred three The following generalizations seem 
warranted from these and previously repoited data 

1 Reliabilities are predicted within the allowable error up to 
thirty judgments 

2. The three traits sampled in this investigation vary significantly 
in leliabihty Stimulation of Intellectual Curiosity, for example, 
means more different things to students than does the tiait Piesenla- 
tion of Subject-matter, 

3 In general, ratings by from ten to twenty students on a single 
trait for instructors differing sensibly in the amount of the trait pos- 
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No r’a 

No ot 

Average 

Correlation 

Dili 

PEdHt 

( 

Uiff 


GomputeJ 

instructors 

observed 

prcdiotcdi 

PEdlH 


Trait 6 IVcscntcition o( aubjcct-mnltcr 


1 l>8 1 

2 5 T8 £ 6 

210 rs 210 

215 m 216 

220 va 220 

230 va 230 

20 

B 

6 

6 

1 

1 

37 

.W 

20 

7 

Id 

10 

410J: 001 
730-t 062 
8U± 013 
8871 063 
S77± 013 
870± OfiO 

7831 061 
8781 051 
016-1 007 
0351 038 
0661 030 

047 

033 

028 

068 

080 

0S2 

,0GD 

086 

067 

068 

.0 

6 

2 

1 0 

1 4 

Trait lO stimulating intcllcotual ouriosily 

1 1 

10 

37 

3611 007 





2 5 M, 2 5 

6 

ao 

4701 080 

7331 OSG 

264 

122 

2 J 

210 M 210 

5 

20 

7171 073 

8101 077 

120 

100 

1 2 

216 M 216 

B 

7 

852 1 070 

8021 OOG 

oto 

110 

3 

220 va 220 

1 

13 

0361 111 

0161 066 

270 

121 

2 3 

230 M 230 

1 

10 

806 1 076 

0131 016 

138 

087 

1 a 


Tmt 1 InlcrcBi in subject'maUer 


1 V9 1 

10 

37 

Pipi 



n 


2 6 IS 2 5 

’ B 

30 



067 


6 

210 M 210 

6 

20 



080 

Bilfl 

7 

216 M 216 

5 

7 



100 

170 

0 

220 vs 220 


13 


soil 081 

087 

105 

s 

230 vs 230 

■ 

10 

flB 


,011 

071 

2 


Sums of nil traits 


1 sa 1 

10 

37 






220 va 220 

1 

40 



000 

043 

1 

230 VB 230 

1 

10 


9331 0431 

001 

060 

1 


0746o(l - rs) 

' Tbcso r’fl were caloulntod by iiicnnB of Slicn's lormulfti PE« = — 


Seo bi8 


V'A'fl + (« -1)*-]’ 

nrhclo, A Nolo on tho Standard Error of the Spearmnn-Drown Formula Journaf of EdueaUonal 
Psycholooy, Vol XVII, 1026, pp 03-04, also DoubIbb, Ilarl A , A Note on tho Corrootnoas of Certain 
Error Formulas Journal of Edueahonal Psi/eholaoViyo\ XX, 1050, pp 434-437 


sessed yield reliabilities which compare rather favorably with the 
reliabilities reported for standardized mental and educational 
tests 

4, It is piobable that in the majonty of situations in which sub¬ 
jective judgments arc used—personnel ratings, stock judging, debate 
judging, beauty contests, juiy verdicts, political polls, etc. the 
Spearman-Brown piophcoy foimula indicates the number of ] udgments 
required for a given reliability, although here it must be admitted that 
we are going beyond the known facts 






























SEMI-LOGAUITHMIC VEBSUS LINEAR PLOTTING 
OF LEARNING CURVES 

EIC1LS.RD W. H0SBAND 
Univeisrty of Wisconsin 

The uau&l methods of plotting learning curves, say of tunc or of 
errors, using linear functions in both vanables, have coi lain limitations 

L The actual shape of Iho cuivc will vaiy considerably with differ¬ 
ent spatial separation of successive units If the spread is wide, the 
whole curve will be rounded out, approaching the so-called “typical 
concavity." If it is small, the cuive will be flattened out neai the 
base line 

2. The unit gains tend to be artificial, and dependent on the arbi¬ 
trary intervals chosen. Reduction from ten to nine errois is uot 
nearly as important or as difUcult to accomplish as fioin two to one 
or from one to zero, yet on a Iincoi* diagiam the two appeal equal 

3 A further difficulty lies in making objective and decisive 
comparisons between curves Aside from theoietical and technical 
interest, the chief functions of quantitative expeiimenlation, including 
the subsequent statistical treatment, arc to compare the relative 
performances or effioiencios of diflforent groups or techniques Exam¬ 
ples arc such questions as two different spaomgs of learning periods, 
dietary or drug conditions, or compansons between several species. 

Just as Thorndike and Koffkft interprot stupidity and insight 
respectively from the same curves, so may two investigators lead 
clear superiority and neghgible differences from a single set of com¬ 
parative curves. The same ambiguity is present in comparing means 
unless we use probability hguies deiived from the standard erior 
of the diffeiencG between the means. With linear plotting we do 
not have available any single figui*e to use m expiessing entirely apart 
from poisonal opinion the differences between perfomaneos in learn¬ 
ing, especially considering tliat we are dealing with a contimious 
tempoial senes. We are more or less limited to aclmiimg the cuives 
from an aesthetic standpoint, and passing n few judgments fioin 
inspection 

Occasionally an ambitious investigator has attempted to tit the 
cuives he has obtained to an equation, in ordoi to express the progicas 
of learning in a single figure or in a single function This is all veiy 
well, but such equations are usually highly specialized, and are only 
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suitable foi the single set of data. They often involve advanced 
mathematics, not an available tool to all expaiiinenters; use logarithms, 
trigonometry, or calculus, niid difficull-to-detcrmine constants of only 
individual application 

All those difliculties melt away at once if one plots the same data 
on semi-logarithmic paper. The horizontal axis or abscissa is used 
for successive trials, as usual, and is kept on a linear basis, as each 
trial IS by natuic equally separated from all olheis. The vertical axis, 
or ordinate, is scaled logarithmically, and the score under considera¬ 
tion, eirors, time, or units done, as the case may be, is plotted on this 
In some cases, owing to the manner in which the paper is punted, 
the original scores will have to be converted into percentages, say of 
initial or of final peifoimance This, however, is no seuous handicap, 
as the oiiginal unit scoies may be written on the axis as well. No 
knowledge of logarithms is needed; plotting is done as directly aa 
when lineal paper is used The giaph paper itself takes caie of 
this function 



Cbabt I —Linear loanimg ourvos (Ordmato) avoiugo number of errors, (Abscissa) 

trial. 

Tins proceduie disposes of the difficulties wo have laised as follows: 
As to the fiist, the shape of the cuive, theie will be no diffeience, no 
matter how it is plotted. Regularly progressive learning will invari¬ 
ably result in a straight hno. The second objection is disposed of, 
as the fundamental piinciplo of logaiithms is proportion rather than 
absolutes. On this basis equal propoitional gams are represented 
equally, no matter at what point in the learning process. Thus, 
reduction from eight to four errors does not show up as any greater than 
does later impiovcment from four to two, oi from two to one Tlioie- 
fore, if an individual learns a constant fiaction of the material on each 
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"trial the successive points will make a etiaight line when connected 
together. This leads us directly to solution of the third defect of the 
former method, that of objective comparisons between cuivos If 
the two or more curves under consideration take practically straight 
lines, we can compare progress made by the various groups by quoting 



Chaht II —Soifli-logntitlvmLo louramg curves COrdmato) average number q£ orrots. 

(Abscissa) tnal 


the number of trials requited by each to reduce by half the error or 
time score, or to double the output. 

Wo include learning curves drawn from the same data by the 
two methods. The data were obtained by the water fiom a group 
of eighty subjects who learned a maze of moderate difficulty. In 
both cases the solid line represents the figuresforthefullgroup (eighty), 
the broken line those (twenty-seven) in the group who learned by a 
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purely ideational method, and the line made up of a dash and two 
dots the motor learners (fifteen). The data were smoothed by a 
moving average of three trials, m order to reduce minor fluctuations. 
This in no way makes any difference in the comparisons, since both 
gets of curves weie ticatod alike The straight lines drawn in the 
logarithmic data are only appioximate, it must be admitted, but 
the deviations of the individual points are seem to be remarkably 
small. 

Let us now give sample interpretations of the two sets of curves. 

(d) Linear Method. —(1) All groups start at about the same 
level. (2) The motor learneia soon me at a disadvantage, while those 
using an ideational attack do bettei than average (3) The differences 
appear to widen up to about the tenth trial, after which theie is 
doubt 

(B) Logarithmic Method —(1) and (2) the same as under (A) 
(3) The absolute diffeiences, as well as relative, are constantly wid¬ 
ening, and as fai as the twentieth trial there is no tendency to narrow 
down. (4) Learning, in this problem at least, is characterized by a 
proportionate reduction of en'ors, which shows up in this chart 
as a straight line (5) Judging by reduction of errors from six to three 
(or any other arbitrary limits) the iiverage individual halves his 
inaccuracies in 6^ trials, the ideational learner in tiiid the motor 
learnei in fourteen attempts 

Do not these last figuiea alone moan much more than any amount 
of verbal discussion, de.scnption, and estimate? In other words, 
wo lose nothing but gain a gicat deal. Yet no complicated mathe- 
matiea is needed m order to make one’s interpretations and compari¬ 
sons. All in all, plotting data on a logarithmic basis gives us clearly 
objective and concise ways of inloipreting data 

The writer does not claim that all learning curves will form a 
straight lino if plotted this way But in trying sixteen different sets 
of figures from maze learning lecords, there was not one in which the 
points did not hover within the normal vanabihty limits of a frequency 
on either side of the lines which weio diawn. Slight curvilineanty 
would not stand in the way of inteipretations on the basis we have 
described. 
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Fundamentals of Educational Psychology, by I M. Gast and E. C 

SkmnGi’ New Yovk, Bcnj H Sanborn and Go, 1929. Pp. 

XIII -i- 364 

Changing viewpoinis in educational psychology necessitate fresh 
treatments of the subject The aim of the authors of tho picaent 
volume has been to relate the subject moie closely to classroom 
practice, to include the social and applied aspects, and to present the 
beat of now opinion and evidence of now movements in education and 
psychology. Then account is expressed m terminology that tho 
average student can understand, uncomplicated by highly technical 
details. Educational applications arc made for every topic discussed, 
The most rocont reliably determined evidence in support of statements 
is consistently roforrod to The authors state that they have not 
attempted to present a “logical system of psychology " They have 
gleaned from a wide variety of sources and from varied schools of 
psychology explanations of phenomena which appear to them to be 
most authentic. The result is a presentation of the subject that 
contains much of the older mateual, tho more famihai topics one is 
accustomed to seeing in a standard text, togethei with new points 
of view and an occasional new chapter, “Mental Health “ “Childhood 
and Adolescence,” "The Gifted Child/' "Nature and Nurtuie,” 
“ Intelligence—Its Nature and Measuremont,” “ Educational Measure¬ 
ments." A list of the psychologists who have contributed most to 
education is given, and a unique feature of the book is the inclusion 
of their photographs Questions and pioblems for fuither study, a 
list of references cited in the text, and suggested readings follow each 
chapter 

The author.? have avoided critical discussion of diveigent opinions 
and antagonistic theories of different schools of psychology The 
newer inteiprefcations of gestalt psychology are scarcely mentioned 
Description of the physiological bases of behavior has been limited 
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to a few of the most essential facts which are stated in the introductory- 
chapter The authors appear to be committed to a “conditioned 
reflex” interpretation of learning, although the diacussion is not at 
all times consistent. Their explanations of learning, habit formation, 
and skill impresses the render as being the least commendable of all 
the topics discussed The educational applications contain many 
excellent ideas which might well have been expanded oi more fully 
explained Too often they arc in the form of advice which is not 
closely related to the psychological principles presented and not 
pertinent to the subject discussed The result is occasional lack of 
coherence These defects are minor and do not detract from the 
usefulness of the book as a source of material for the student of educa¬ 
tional psychology. Gertrude Hildreth. 

The Lincoln School of Teachers College. 


in The Organization of Characta, by Hugh Hartshorne, Mark 
A May, and Frank K. Shuttleworth New York. The Macmillan 
Co Pp. 603 

This volume brings to a close the work of the' ‘ Character Education 
Inquiry.” It follows “Studies in Deceit” and “Studies m Service 
and Self-control,” and is in many respects the most important volume 
of the three. It contains the following parts’ 1. Social Intelligence 
and Social Attitude; II Interrelations of the Factors of Character; 
III, Components of Character; IV. The Significance of Integration; 
V Conclusions of the Chaiactcr Education Inquiry. 

Those who have followed the work of the “Character Education 
Inquiry” will recall that the investigation showed that deception, 
helpfulness, cooperation, persistence, and inhibition weie groups of 
specific habits, rather than general trails. “One could hardly predict 
from what a person did in one situation what he would do in a different 
situation ” Theie are, however, obvious differences in individuals 
in the degree to which then behavior is of a consistent pattein. It is 
chiefly with the study of this inner consistency that this volume is 
concerned 

To eight hundied fifty children in the fifth to eighth grades of three 
school groups (or composites) were given a large battery of tests, 
including tests of moral knowledge and attitudes, tests of deception, 
of cooperation, of inhibition, of persistence, of suggestibility, of 
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^'neivous instcabihty,” and vaiions rating schemes, for determining 
"level of social fimctiomng,'’ reputation, and the like Measures of 
intelligence and home background were also available 

The coirelations between the vaiious objective tests, even when 
corrected for attenvation, showed littlo relationship between gross trait 
scores. For example, honesty oorrelatos with scivice 439, with 
inhibition .487, with peisistcnce .166, "This meager consistency m 
behavior of good or socially desirable types may seem lamentable, 
but wo shall have to conclude that consistency in not characteristic 
of children . . Wo cannot infer fiom the conduct teats the presence 
of a general factor.” 

The effect of group standards on conduct was investigated, and 
while there was little relationship between an individual’s ethical 
understanding and his conduct (aside fiom the relationship existing 
through intelligence), there were definite relationships (aside from 
intelligenoe) between knowledges of right and wiong and actual 
conduct when classroom groups were considered as a whole 

Probably the most immediately valuable part of this report is that 
dealing in a very detailed manner with the integration of honesty. 
Other of the oharnotei traits might have been investigated, bub the 
honesty tests were used since they woio the most comprehensive 
battery available It will be remembered that the interoorrclatlon 
between the various honesty tests was very low, leading necessarily 
to the doctrine of specificity of reaction in this field. Now if the 
scores of a child in each test be distributed, and a measure of dispersion 
computed, we have a measure of the degree to which the child tends 
to be consistent in his behavior—be it honest or dishonest Twenty- 
one tests were used For each child the SD of his scores was computed 
This is called his index of integration Thus a perfectly honest 
(or dishonest, or 50 per cent honest) child would have an index of 
0.00. When the unreliability of the tests used was compensated for, 
there still remain large differences in integration These integration 
indices wore correlated with total honesty score The correlation, 
corrected for attenuation, is about 80. This means that the moie 
honest a child is the more consistent is he in his honesty. The possi¬ 
bility that this icsiilt IS an artefact of the nature of the testing set-up 
IS interestingly and fairly discussed, pro and con. It is concluded that 
in so far as the test situation is responsible for the coirclation, it is 
nob artificial in that the same factors which make the more honest 
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ohilclren more consistent in their tost results also are operative in the 
life situations calling for honesty 

The implications of the above arc interesting Although moral 
conduct IS, m the main, largely specific, it is shown that as conduct is 
improved there lesults a general impiovomcnt It is the behavior 
of the dishonest child which can be most readily modified 

It IS difficult adequately to appraise a study so vast in its scope 
as this work It is ceitam, however, that this Inquiry is of leally 
tremendous importance to education. And the present volume is 
easily the most interesting and valuable to the non-research person 
in the educational field. Donald Snedden 

New York Univeisity. 


Ue&emch Methods and Teachers' Ptoblems, by Douglas Waples and 
Ralph W. Tyler. A Manual for Systematic Studies of Classroom 
Procedure. New York, The Macmillan Co , 1930 Pp, XXIII 
■f 653. 

The solution of administrative and instructional problems by 
research methods la an important aspect of modern educational 
practice The research worker now has at his disposal a group of 
publications describing research technique to which the present 
book, designed as a text for teachers, administrators and technicians 
13 an important addition. Ecsearoh is interpreted by the authois’ 
in a broad sense as including not only laboratory experimentation but 
the study of service piobicms such os the teacher or administrator 
meets in operating a school. The authors, however, distinguish 
between these two types of research, pointing out the narrower scope 
and more intensive approach in laboratory studies Such a problem 
as testing and classifying a group of pupils is considered research 
though distinguished from laboratory experiments m measurement 
and classification 

The authois have devised a working plan for leseaich projects in 
general, divided into several major steps The types of data needed 
for typical problems arc listed, available souices of data are 
enumerated, and methods of obtaining data from available sources are 
outlined The research problems commonly met by educators are 
classified m tliicc groups, problems of the curriculum, of teaching 
methods, and of school management. For each of these three classifi¬ 
cations appropriate methods of attack are outlined and illustrative 
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studies are presented in outline form A list of sixteen different 
techniques or methods of approach with an evaluation and description 
of the method of applying each concludes the book Adequate 
bibliographies are provided at the close of major topics 

No book on lesearch methods can of itself produce experts in 
educational research, just as the expert cook is not necessarily the 
product of a cook book, but just as the cook’s technique impioves with 
training in method, go may the research student improve hia experi¬ 
ments with increased training in technique. To follow any tioatise 
on research methods slavishly would be to defeat the voiy purpose of 
research. In using the book under discussion some students may be 
inclined to accept too readily the interpretations of the authors and the 
carefully detailed outlines without exercising originality or independ¬ 
ence of judgment. When the outlined pattern fails to fit, the student 
must be resourceful and intelligent enough to alter or adapt it. The 
authoiB unfortunately give no dlscussioii of the use of research m 
modernizing educational methods. GisnTiiiiDE HinniiETn. 

The Lincoln School of Teachers College. 



THE JOURNAL OF 

Educational Psychology 


Vol ume XXII _ February, 1931 Number 2 

PRACTICE VERSUS GRAMMAR IN THE LEARNING OF 
CORRECT ENGLISH USAGE^ 

PERCIVAL M SYMONDS 
Tcaohera College, Columbia Emvorsity 

Recent correlation studies have shown httle relationship between 
knowledge of English giammar on the one hand, and the correctness 
‘ of usage on the oilier Those who aie familiar with these studies 
commonly believe that tho value of English grammar m influencing 
correct giammatical usage m speaking or writing has been definitely 
discredited. But correlation studies have frequently misled in the 
past regarding tho actual dynamic relationships in learning and the 
amount of tiansfer that can bo expected. Grammar still has a some¬ 
what thriving existence m our schools 

In 1906 Hoyt^ reported a correlation ns low as 18 between grammar 
and composition ability among high school pupils. Rapeei® reports 
the same lelationship to bo 23. Segal and Bari^ in a minor study 
reported a correlation of 48 between a lest of formal grammar and a 
test of "applied giammar” which is really a test of ability to choose 
the coireot form. Asker® reached similar conclusions by a dift’eient 

‘ The authoi is indebted to Mi. Ficdorick Graham, foinieily principal of P, S 
210 Biooklyn, Mi Jacob Theobold, principal of P S. 165 Manhattan, Mr Abra- 
liam Ehrenfeld, principal of P S 10 Manhattan, and Mis Ruth D SeliattGles, 
formerly pnncipal of P S 87 Mnnhatlon, for thoir most helpful cooperation in this 
experiment, and to the many toacliors who pai ticipated 

*Hoyfc, F S.. "The Place of Grammar iii the Elementary Curriculum" 
Teachers College Record, Vol VII, Novembci, 1906, pp. 487-600 

®Rapecr,L W : '‘TheProblemofFoimalGrammarmBlcmentaiyEducation " 
Journal of Educational Psychology, Vo! IV, Maioh, 1913, pp 126-137 

•* Sega, D , and Bair, N R "Relation of Achievement in Formal Grammar to 
Aolnovomcnt in Applied Grammar ’’ Journal of Educational Research, Vol XIV, 
December, 1920, pp 401-402 

® Asker, W’ "Docs Knowledge of Foimal Grammar Fiinotion?" School and 

SocKUj, Vol XVII, Januaiy 27, 1023, pp 109-111. 
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method. Tho geneial conclusion reached from these correlation 
studies, to quote Segal and Bai'r, is that “foiinal grammar has no 
immediato tiansfer value so far as applied English giammar is 
concerned.” 

However, the tiue test is the expenmenial test. What lenl 
influence does learning English grammar have on usage? To deter¬ 
mine what influence exists, the wiitor cairicd out some tcst-teach-test 
experiments in Grade VI of four New Yoik City elcmontaiy schools 

The test winch was used m the experiment consisted of forty items 
and was modeled after the Chaiters Diagnostic Language Tests 
Each item (except the fiist) consisted of a aenienco having a giam- 
matioal ciroi to be conected by tho pupil by rewriting the sentence 
in tho space beneath the item Samples of the items are. 

14 Are you most ready to go? 

28. He said that I was most there. 


Previous expenence with the Ghartcm test indicated that the 
lowest initial scores, and consequently those items of greater difliculty, 
were made on adjectives, adverbs, prepositions, and conjunctions, 
Consequently in planning for this experiment all of the items selected 
for this test were of these types. This lest was called Test I, and was 
always given first as well as last m the expeiiment, with the hope of 
discovering what changes took place on the test(duc to the activities 
earned on m between 

The technique of the Chai'ters test was letainod as the best simple 
measurable evidence of usage It would have been possible to have 
made the test a tiuer measure of choice in an uncontrolled situation, 
but probably at sacrifice of sociability and reliability On the other 
hand in using a recognition teat, pupils would have been moie keenly 
attentive to differences in form and it would have too narrowly a test 
situation and not enough an opportunity to recognize spontaneously 
when a form is incorrect and what the con’eot usage should be 

In every case Test I was immediately repeated at the opening of the 
experiment, and all gams woie computed from tho second application 
of the test instead of tho first m ordei to eliminate the influence of 
practice on the test Tho average practice effect was found to be 114 
Six different experimental procedures wero tried. Each procedure 
was conducted in thieo classes in a different school under very caiefully 
controlled conditions It was believed that in concentrating a pro- 
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cedure wiihm a school there was less danger of having teachers discuss 
what they were doing and hence vary their piocedure from that which 
was defined for them No attempt was made to equate groups except 
the rough one of choosing Grade VI gioups This defect in experi¬ 
mental procedure is recognized. The possible inaiicnce which dif¬ 
ferences in selection in tho groups might have on the results and 
attempts to allow for possible diffcrcncea will be discussed It would 
have been possible to carry out tho study on the scale contemplated 
if tho orthodox equating techniques had been followed. 


Experimental Phocedtjrb I: Repetition or Correct Forms 

Four classes in each of two schools, P. S. 10 Manhattan and P S 
210, carried out tho cxpeiiment in puie repetition m 1929. Sheets 
were prepared which contamed forty sentences each of which were 
grammatically correct. Each sentence contained a usage which 
which coitesponcled to a similar incorrect usage in Test I. Examples 
of items in this sheet of correct sentences (Exorcise A) are as follows 

14 The boy wna almost killed by an automobile. 

28 My baby brother is almost two years old 

Exorcise A was dislribuled to each child and directions to the 
teacher stated. 

Have the class icad thiougli tho aentonccs aloud and in unison. Iieb the 
teachoi first read tho ntimboi of tho itom and tlion tho class read the sentence. 
Do not let Iho ohildicn liuriy Sco that tlioy read slowly and diatmotly. See 
that cveryono leads Do not allow tho class to repeat any of tho aentonccs 
unnecessarily K tho class lends a sentence incorrectly or mispronounces o. word, 
liavo them repeat it (once) correctly 

The sheets wcie immediately collected when this reading was 
finished This device made possible one repetition of each correct, 
form by each child 

In order to chock up on the influences of different amounts of 
practice on this new test (Test I) as compared with one previous experi¬ 
ment, one refettlion of JCxcrciBe A was given between the two applica¬ 
tions of Test I m two cIrhsos, three reipclilions between tests m two 
classes; five repetitions in two classes; and ten repeiiiions in two classes. 

This part of the experiment was designed to give a measure of the 
influence of sheer iei>etilioii with ■which the results of othei experi¬ 
mental proccdiu’es could be compaicd 
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EXTEMMENTAIi PllOCTSD-aUB llj RtSPBTITIOH OF COTIIIECT? AND 
Incorbect Forms 

Id this section of the expetiment earned out in P S 165 Manhattan 
in 1929, mere repetition was again studied, but in this case both the 
correct and inconect foims wei’e repeated,side by side This new 
exercise (Exercise A, Foim 2) was distributed to the children with 
directions that it be read aloud and in unison aa a class as in the pre¬ 
vious procedure. Three icpetitions of this cxeiciso weie interpolated 
between the tests and the results were comparable to the three repeti¬ 
tions used in the first experimental proceduio 

Examples fiom Exeiciae A, Form 2: 

14. ThoboywaamoatkiUedbyamuito- 14 Tlio boy vvaa^almoat killed by atv 

mobile automobile 

13 wrong IS right. 

28. My baby biother IS most two years 28 My baby biothor is almost two 

old yeais old 

18 wiong la right, 

The pupils road ts wong or is nghi after each sentence 

Experimental Procedubb III’ Knowledge of Definitions, 
Rules, and Pjuncifles and Grammar 

In this section, carried out in P. S 87 Manhattan in 1929, an 
attempt was made to determine the mSuence on usage (Test I) of 
mere learning of grammatical rules and principles A grammar study 
guide was prepared containing defimtions, lules, and principles which 
applied specifically to the errois m Teat I. 

It was an original intention to include in tins first edition of the 
grammar guide only bare definitions and rules with no illustra¬ 
tions. But this seemed such a formal procedure for eliildron in a class¬ 
room even in an experiment and so far removed from school procedure 
that illustrations were mduded This expernnont does not tell us 
how much the illustrations in dlummaling the rules influenced the 
results. 

Teachers were cautioned as follows: 

Do not do any of the following 

Do not ask pupils to make up examples of thou own illuafciabiiig the 
rules. 

Do noi give the pupils additional oxamplsa of the rules. 

Do not ask pupils to onolyao tlic rulc% 

Do Hoi give the pupils practice in applying any of tlio rules 
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The three teachers cooperating m the expevircient were instructed 
to drill their pupils m memorizing tho definitions, rules and principles 
so far as time permitted. Fifteen or twenty minutes a day foi two 
weeks or more wore used 

A sample of the grammar guide, as it applies to the particular 
items aheady given fiom the test, is given below 

Mosl and almost aro often confused. Most is an adjective and should modify a 
noun 

Example MoU boats cairy life picsorvcrs 

Almost is an adverb and sbould modify a verb 

Example* John has abnosC finished his work. 

A sheet of “Questions on Rules for Coriect Usage of Adjectives, 
Adverbs, and Conjunctions** was also supplied to each child 

Illustrations of items aie: 

22 IVliat part of speech is most? 

23. Wliat part of speech is almoslf 

The teachers wore instructed to use these sheets with the pupils 
m drilling them on these definitions, etc 

Finally a “Test of TCnowledgo of Rules for Coireci Use of Adjec¬ 
tives, Adverbs, PieposiUons, and Conjunctions” was prepared This 
■was to be given to the clnsa after tho study of the grammar -was finished, 
but before final Tost I 

Samples of items on this test on grammar rules are 

22 Most 18 an (1) adjective, (2) advcib, (3) proposition, (4) conj'uactioii- ( ) 

23. Almost la an (1) odjcctivo, (2) advoib, (3) proposition, (4) coujunotion 

( ) 

The teachers were given the express goal of preparing their pupils 
for this test on grammar rules, using every ineana at their command, 
direct or indirect They were to aim at one hundred per cent on the 
grammai lules test if possible and the extent to which they reached 
this goal was a measure of llicii success in teaching the grammar 
rules. That they wcie remarlcably successful in this is evidenced 
by the fact that out of a total possible scoic of 36 on this test, the three 
classes averaged 33 1, 24 2, and 30.1. 

The puiposo of this vvoik. was to discover what influence the learn¬ 
ing of the rules had on Test I 

Experimental Piiocbduhb IV* Gbammar Analysis 

The fouith experiment was cairied out in one class in P. S 87 
Manhattan and two classes in P S 210 Biooklyn in 1930 In this 
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pait of the experiment the value of ability in the grammatical analysis 
of sentences in improving English usage was studied. Experiment IV 
went one step further than Experiment III and gavo pupils practice 
in analyzing the grammatical oonatniction of ceitain words and 
phrases A new grammai guido was made which included nob 
only the defimtiona, piinciplcs and lules as bofoie, but also certain, 
exeiciscs in which pupils were expected to recognize and name the con¬ 
struction In Experiment IV teachers wcie instructed not to do any 
of the following: 

Do not have the pupils raemorizo or loam tho lulea or ininciplos 
Do not give examples of or cmphaaizo tlie wrong foim in any of the excroisea 
Do not give tho pupils practice m applying any of tho rules 
Do not have the cliildicn moke up illuatrntions of thou own. 

Everything should conccntiate on having ohildrcn learn to analyzo the sen¬ 
tences given 

Besides the definitions and examples m the grammar manual 
which are similar to those used in the previous expeiiraent exeioises 
were included of which the following are typical: 

1 Most boats carry life presciveis / Mosi is an_ 

and modifies_ 

2 John has almost fimshtid his work Almost is an_ 

and 3nodific3___, 


A test of thirty-foul items with a total possible scoi e of sixty-one on 
“Grammar Analysis" was prepaied and the teachers cooperating 
m this experiment were instructed to do everything possible to prepare 
their pupils to do well on this test. Their success is evidenced by 
average scores of 37.9, 42 6, and 42 8. 


Experimentai/ Procedure V. Choice of Correct Constructions 

Experiment V, which was conducted in P S. 10 Manhattan m 
1930, tested the value of practice in choosing correct constructions on 
English usage as measured by Test I 

A new grammar guide was again pieparecl including not only the 
necessary definitions, pnneiples, rules, and illustrations, but also 
exercises in which pupils were given practice in choosing correct 
constructions Samples of tliese exeiciscs on the same distinction 
mosi and almost are * 
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Exercises on Use of Mosl and Almost — ^Inseit most oi almost m the following 
blank spaces' 

1 Are you___over your cold? 

2 ,__birds build ncata 

3 Which IS tho_ fun? 

In this Gxpeiiment fclie teachers were instriiotcd to limit their 
teaching strictly to giving the pupils practice in choosing the correct 
constructions. They were told not to have the pupils memorize or 
learn lules oi piinciples, not to give examples or emphasize the wrong 
form in any of the exercises, not to analyze the constiuctions in any of 
the examples or exorcises, and not to have the children make up illus' 
trations of their own 

As before, a test was prepared on the choice of conect constructions 
and teachers were expected to help prepare their pupils directly for 
this test. Items in the lest were of the same kind as the practice 
exercises, illustrations of which have already been given. The success 
of the teaching may be seen from average scores of three classes The 
scoies were 24.3, 24 4^ and 26 7 out of a possible 33. 

In this proccdui'e, as in the other, Test I was given first and last, 
the aim being to see what effect the practice in choosing correct con¬ 
structions has on Test I. 

Experimental Thocedtikb VI; Whole Program 

In 1930 the whole program comprised m the previous experiments 
was tried out in P S. 165 Manhattan After Test I, the grammar 
manual was distributed and pupils in thiee Grade VI classes learned 
the various definitions, principles, and rules, piacticed analyzing sen¬ 
tences for the constructions of certain woids, and practiced choosing 
correct constructions. When all this was done tests wore taken on 
knowledge of grammai lules, ability to analyze certain constructions, 
and ability to choose correct foims This was capped by thiee 
repetitions of the right-wrong foims of Exercise A, Form 2, described in 
Procedure II Then Test I Avas repeated. The average scores on the 
tests for three classes were as follows 
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TAniiii I — Aveiuqe Scores on Knowledge, Analysis and Choice Tests Given 
TO These Ci^Af-sEs in PnoCBouiiB VT 



Knowledge 1 
tcsl 


Choico test 

Total possible scoio 


01 

33 

Class VIA 


56 4 

31 4 

Glass VIBi 

BSEH 

46 8 

27 6 

Class VIBa 

■Hi 

30 1 

20 7 


Table II — Scoues Made on Tost I BiapoBB and after an 'Experimental 
PuOCBDUUB TOGBTIIBU ^ViTtt GaINS BY GLASSES AND AvERAQE GxiNa 


Expcnmentnl Pio- 
ceduio t 
piacticc 

One 

lopofcitjon 

Thioo 

icpctilions 

Five 

lopctitions 

Ten 

lepetitions 


P S 

P. S 

P s 1 

P S 

P S 

P S 

P S. 

P S 




10 


10 


10 

210 


VIAa 

1 VIBni 

1 1 

VIAi' 

1 1 

1 VIA, ! 

1 1 

VIB 4 

1 VIB, 

Vllia 

[ VIAa 

SpcoikI test 



10 4li 


8 33 

^ 22,46 


7 69 

Pirsb tost 


16 55 

g 22 

12 24 

7 Oij 


5 70: 

7 71 

Gam 


4- 32 

+1 32 

- 65 



-1- 78 

- 12 

Average 

-f 36 

+ 34 

-1-1 


+ 

33 


Expcmwcntal Pioccduie II, piaetice on light 
find wrong, P. 8 105 

VIB, 

VIB, 

! VIBa 

Scaond lost 

Fust Lest 

Gain 

Avemgo gain 10 11 

24 77 
16 00 ' 
4- 0 7 7 

21.70 
12 26 

24 48 
13 36 

4- 0 44 

4-11 12 


Expcuinental Pioccdiuo III, leaiiung lules, 

P S. 187 

VIB, 

VIBa 

VIIA, 

Second test 

26 14 

13 37 

23 SO 

Fust test 

17 20 ' 

10 26 

17 48 

Gam 

8 24 

3 11 

6.33 

Fmean Main 

Average gam ,6.80 

32 

73 

76 
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Tadi,b II —Conhnmd 


Experimental Pioccdure IV, analysiB, P S 

87 and P S 210 | 

P S 87 
VIB 

P S 210 
VIB 4 R 


Second test • 


10 28 

16 02 

Tirsb test 

19 83 

11 00 

12 23 

Gam , 

4 07 

1 6 28 

2 79 

ffmean gain 1 

Avciago gain 4 OB 

84 

! B9 

50 


Expenmontal Piocecluro V, choice, P S 10 

VIBi 

VIBa 

VIBi 

Second test 1 

■Q 



Pirst test 



11 68 

Gam 

9 05 


0 82 

0 movD sain 

Avoiage gain 8 01 

55 
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Expenmental Piocecluio VI, total program, 1 
P S 1G6 

VIAi 

VIB, 

VIBs 

Second test 

First test 

Gain 

^rnesD enln 

Average gnm 13 37 

29 40 

13 46 

28 72 

16 03 

28 20 

14 72 

15 96 

76 


|H 


Before discussing the significance of the lesults consideration must 
be given to possible extraneous faotois whioli may have influenced the 
results The groups weie not equated, as was previously mentioned, 
except by the rough method of selecting Giade VI classes (one class 
was a VIIA section) It may be seen by inspecting the average 
scores on the fiist test m the above table that there are wide differences 
in initial language usage It is possible that there are also differences 
in geneial ability, and it is concensible that the'brighter classes might 
gam so much more from the expenmental pioceduie than duller classes 
by Viitue of their brightness as to invalidate the appaient differences. 

These possibilities weie investigated by finding the coiielations 
which exist between vaiious factors. 
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Tadi,k III — CoEJPFiciuNTs OP CorubiiAtion dbtwedn Mental Aqe, IQ, Initial 
ScoiuB ON Test I and Gain on Test I 



Initial 

score- 

gam 

MA- 

, initial 
j score 

IQ- 

' initial 

1 score 


IQ- 

gam 

Experimental Prooodnrc III (rules) (avciage 






three classes) 





+ 084 

Experimental Proeecluie IV (analysis) 






(Average three classes) 





+ 167 

(Average two classes) i 




-h 076 


Experimental Pi'occdmoV (choice) (onedass)^ 


1 

+ 4161 


+ 163 

Expoiimental Pioeechue III (rules) 






(Average three classes) 

- 135 





(Analysis) IV (avcinge three classes) 

-.27l| 





(Choice) V (average three classes) 

- 440 





(Tolal) VI (aveiage thiee classes) 

- 334 





Aveiage 

- 298 





Con elation for total group 

-.138 






These correlations indicate that tlieie is a marked negative correla¬ 
tion between initial score on Tost I and gain on the test In other 
words pupils, making the lowest initial scores on the test make the 
greatest gam. This is probably an artifact of the test. Pupils with 
the higher scores do not have room enough on the test to make as great 
gains as those malung lower scoies. That this factor had no appreci¬ 
able effect on the average gains by classes is seen fiom the following 
table If this factor did influence average gains by classes, then the 


Table IV.— AvsnAGB Initial Scohh and Aveiiagb Gain for Each op the 
Experimental pROGEDUREb 


School 

Bxperimontal pioccdures 

Average 
' initial 

1 score 

Average 

gam 



One icpotibon ' 

10 48 

-1- 36 

P. S 10.. \ 


Three repetitions 1 

10 73 

-h 34 

p s. 210, , , ; 


Eive lepotitions 

13 89 1 

-f- 1 60 



Ten repetitions 

6 71 

H- 33 

P S. 166 

Practice' night and wrong 

13 64 

+10,11 

P S. 87 

Eulea 



6 89 

P. S 87 and P. S 210 

Analysis 


14 36 

+ 4 06 

P S 10 

Choice 


12,08 

+ 8 01 

P S 166 

Total program 

14 73 

+13 37 
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differences are i oally greatei than they appear, for in this table there is 
a tendency foi those classes with the highest initial average score 
to make the most gain. 

There is also a marked correlation between intelligence and initial 
score in Test I. The brighter pupils lend to exhibit better language 
usage as measuied by Test I. The correlation of gain and intelligence 
IS negligible although it tends to be positive. Were it not for the arti¬ 
fact of the negative coirelation between initial scoio and gam ifc is 
probable that the correlation between intdligenco and gam would be 
much lavgci Semi-partial coiielations were computed between gain 
and IQ, eliminating initial score from gam,^ showing that the coircla- 
tion between gam and IQ is lower than ifc would otherwise be due to 
the nature of the test 


Tabib V —Semt-baiitiatj ConnBnATioMB between G-ain and IQ Eliminating 
Initial Scohb pbom Gain 


School 

Class 

Conclation 

IQ-gftin 

Correlation IQ-gam with 
initial score elimuiated 
fiom gain 

P. S 87 , 

VIB, 

-.337 

-h 061 


VIB, 

+ 670 

4-,633 


VIIA, 

- 086 

-h 168 

P S 87 

VIB 

-1-.379 

+ 419 

P S 210 

VIB4« 

- 018 

4- 236 


VIBe« 

-I-.I37 

4- 163 


The influence of general ability of a group may have had some 
influence on the gams, but probably mot much. The correlationlis 
positive but low The classes in P S. 166 had high IQ's on the average 
and in both oases made the highest gams On the other hand both 


* By a sorai-paitml coirolntion is meant the ehmination of the effect of a third 
variable from one of the variables In this ease the foimula used was 


ri» — fiiTsi 

■<.=>. 

whore 

1 = gam 

2 = Initial score 

3 = IQ 

Somi-partml coefliciontg of coirelation wei'e fii'at developed by Pianzen See 
Fianzen, II A Comment on Paifaal Coirelation Journal of ISd'ucational Psy¬ 
chology, 7ol. XIX, 1928, pp 194-197. 
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of the classes in P. S. 210 pnHicipalmg in TSxperimonial Procediue IV 
(analysis) were rapid advancemeni classes with high IQ’s but they 
made comparatively low gains Again the classes m P. S. 10 partici¬ 
pating in Experimental Procedure V (choice) had average IQ’s which 
wei c really low m this experiment and yet their gains woi e high. It is 
not believed that the fact that classes diffeied m initial ability had 
appreciable influence on the results. 

Inteiipbetation op the UESunTS 

1, The results show that meie lepcfcition of coireoi foims cause 
small gains on the lest It is possible that the small gams of 0 3 for 
one, thiee and ten icpetitions of the correct forms could be explained 
as meiQ practice effect The original practice effect between the first 
and second trials on Test I was 1.14> and it is possible that there should 
be another small puictice effect gam between the second and thhd 
trials At all events, when compared with the other pioceduves 
move repetition of coircct foims is very inferior. 

2 If one rocalls the gams found for molivalion as descubed in a 
previous experiment^ it will be seen that they sink into gieatei insig¬ 
nificance than appeared in the earlier article. Motivating devices 
apart from tiie learning experiences offered are practically impotent 

3. It will be soon from Experimental Pioccduro IV that mere 
learning of definitions, rules and principles of giammai yielded an 
appiecinble gam on the usage test This result was wholly unexpected 
and 13 hard to explain. It was thought before beginning the expori- 
ment that mere momorizalion of grammar rules had little or no influ¬ 
ence on usage The cxpciiment, however, indicates that somehow or 
other these Grade VI childicn extracted enough meaning from the 
formal and abstract definitions and rules with which they were prev¬ 
iously iinacquainled to make more coriect changes on the test than 
they did the fiist time. The positive correlations of gams with 
intelligence would indicate that this “transfer*^ was one that the 
brighter children profited by more than the duller children Within 
the limited use of language as found in this experiment it is possible 
to say that meie learning giammar rules does impiove usage 

4 Tiaining in the analysis of gi'ammatical constiuctions and 
practice in the choice of correct constiuotiona each taken alone caused 
improvement in English usage Tho development of ability to analyze 

^Symonds, P M and Chase, Dons Uniter, Piactiec vs Motivation Joui'nal 
oS Educahonal Psj/cfioloffy, Vol. XX, 1029, pp 19-35, 
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sentences for ginmmatical constiuctions apparently had about the 
same influence on iif?agc that memorization of the rules had. Practice 
in choice of coircct expressions had measurably greater influence than 
the learning of rules or analysis 

5 Merc repetition of the right and wiong forms m succession so 
that the distinction between the two is clearly brought out, and so 
that it is definitely stated which is the light foim, had gieater influence 
on usage than any of tho work with grammar. 

6 The whole program including memorization of lulos, practice 
m analysis of grammatical coiisliuclions, choice of coriect foims and 
mere repetition of coiinct and incorrect forms m succession yielded 
results in unproved usage better than any one single method alone 
It is estimated that these Grade VI classes made a gam m coriecb usage 
which is ordinaiily to be expected in three yeais by woikmg on this 
program fifteen minutes ii day for three weeks. The experiment has 
not included subseciuent testing to delcimino the permanence of these 
gains Presumably tlieic ia the usual falling away and the re-adoption 
of habits pievalcnl in home and community 

Discussion 

One thing stands out clcaily. It is the quality of dull oi practice 
that counts and not its amount. Merc mechanical lopetition appar¬ 
ently yields almost no loaining. Instead of increasing the amount of 
drill in scliool subjects, more attention should bo paid to the natuie of 
the drill The best icsulls come by making what is to be learned 
easily idcnlifiablo as Tliorndike has emphasized in recent lectuies 

This study should not necessarily be interpreted as a justification 
of the teaching of English grammar Giammar does have an influence 
on usage, but at what cost? Without doubt for most children the 
difficulty and trouble of learning grammai' aa a means for improving 
usage IS 80 great that more diiect attacks on usage are certainly more 
profitable Our own lesults show that ineie repetition of correct 
forms, where it la clearly indicated what is coireot and what the critical 
point at issue is, has inoi e influence on usage than any procedure with 
grammar. 

Poi gifted children tlic study of grammar may be pioStable 
In the fiist place, Iho gifted child leaina grammai lelatively more 
easily. In tho second place, with general punciples to woik from, a 
knowledge of giammar will covei more cases Whoever really com- 
pichends a generalization lias command over a much wider range of 
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specific applications. But the average child finds iL difficult to learn 
the definitions, rules, and principles, and finds it difficult to apply them 
when learned. ]?or most children learning correct usage is more 
profitably accomplished when the specific items are learned directly 
The child who has learned by direct practice to distinguish right fiom 
wrong usage is probably better equipped to learn the giammar which 
gives a logical explanation of the habits of correct usage which he has 
formed. In this sense giammar is a summary or epitome of the usage 
which haa already been learned du'ccfcly, rather than a tool for guiding 
the learning of correct usage. In the writer’s opinion it is relatively 
unprofitable foi the aveiage child cither to study grammar as a means 
for learning correct usage (because there are more ducot, simplex, and 
easier means for learning usage) or as a means of summarizing the cor¬ 
rect usage which one has learned (because there are other things more 
worthwhile in the curnoulum). 

In all the expeiimental work it is tacitly undorstood that pupils 
are making some effoit to do well m school, to do well on tests, to 
please the teacher, to do what other children arc doing, to learn new 
things, and the like Unless there was some driving force the pupils 
would never have taken the testa, or attended to or learned the exer¬ 
cises Oui previous experiment showed that additional stimuli to 
learning cannot be imposed from without. But there must be a 
minimutn of driving force which can be depended upon to direct the 
children’s attention to what is to bo learned. The selection of mate¬ 
rial in harmony with pupil’s interests and previous learnings is certain 
to produce better learning results than when interests and previous 
learnings are disregarded. 

It IS always questionable as to how far the results of a single experi¬ 
ment can be extended to apply to dissimilar situations. The’ writer 
likes to behove that these expeiimental icsults apply to problems of 
conduct in general This experiment demonstrates that mere learning 
rules or codes has a direct influence on conduct, more for the brighter 
children than foi the duller children. Apparently these children 
extract enough from the fonual rules to apply to their own behavioi 
The practical pioblom, however, is not Can rules function in conduct? 
but What IS the most economical method of guiding or controlling 
conduct? This depends partly on the pei^on’s ability to comptehend 
generalizations and apply them to specific situations. Piobably for 
the majoiity of people the simple direct method of telling them what 
IS the "right" or best thing to do will produce the best results. And 
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if it is not known or not certain that one thing rather than another is 
right or best, or if it depends on the circumstances, then it is preferable 
either in the first luslance to teach nothing, or m the second instance 
to give considerable help in solving the problem which will fit the 
lesponse to the oircumstanoes. 

Finally, a word as to the expeiimental attack on piobloms of this 
type as compared with correlation methods Correlation analysis 
13 essentially static. It merely reports the results of whatever methods 
or combination of methods have produced the present situation. 
Correlation analysis does not begin to exhaust the possibilities m 
method—it does not even experiment with method. Correlation 
analysis is extremely limited insofar as its guidance for education is 
concerned The point has been reached where the correlation method 
has about exhausted its possibilities. The time has come for a more 
earnest use of the experimental approach to problems of learning and 
education. 

However, if the experimental method is to be used it must give 
heed to the law of the single vaiiable Every true experiment m 
education presents an artificial educational situation. Time and 
again duiing the course of the work reported in tins article, principals 
and teacheis would complain that the methods which were being 
used were too foimal and diy to be practically used. To this I would 
agree To most persons an educational experiment must make use of 
the best conceived organization of methods and materials possible. 
Not so. The actual educational situation is too complex to be used 
in experiment. When one has compared one actual classroom method 
with another, one does not know to what specific factor to attribute 
the lesults In true experimental woik a single factor must be pulled 
out of its setting and alone be allowed to vary Only in this way is 
it possible to build up educative procedures that are based on correct 
principles 



A SCALE OF AIILITAUISM-PACIFISMi 

D D DROBA 
Univoisity of Cliicngo 

The Prodlexi 

Tho purpose of this article is to describe the construction of a 
scale for the measurement of railitaiism-pacifism The teim "mih- 
tarism-paoifism” is used lieixi to specify a particular attitude, In a 
very broad sense it denotes a predisposition to act with reference to 
the issue of war ys. peace. 

To measure militariam-pncifism directly is impossible One cannot 
enter into an immediate contact with the predispositions of other 
peraona. Aa an indirect measure of attitude the verbal expression 
of a pei'Bon, in the form of statements, was chosen The statements 
cover the following topics in this field: Causes of war, purposes of wai, 
results of war and peace, what is to be done at present about war and 
peace, what is to be done m case of war, and general judgments about 
peace and war. 

Wo can assume that thoie is some relation between action and 
verbal expression. That is, n pcison who endorsed militaristic state¬ 
ments would probably tend to act like a militanst, and a person who 
endorsed pacifistic statements would be likely to act like a paci¬ 
fist. However, no assumption is made as to the extent of relation 
between the verbal expression and action. If it is discovered that 
a person has endorsed statements indicating a pacifistic attitude, 
one cannot be suio that he will also act exactly in aocoidance with 
his endorsements 

In the piesent study verbal expressions or opinions will be used to 
designate the successive steps on the mihtansm-paoifism scale In 
constructing the scale it will be desirabl© to find some way of detei- 
mining the distances between the successive steps on the scale. It 
will be desuable, fuithermorc, that the distances between the steps 
he approximately equal. How to equalize these distances constitutes 
the chief problem 

To aummaiizG, the mam problem of this experiment is to construct 
a scale of nuhtansm-paeifism with approximately equal steps on the 


* Tlio scale, m a modified form, together with instructions for its use, wns 
published by the University of Chicogo Reas. 
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scale—the steps to be represented by statements of opinion concerning 
wai and peace. 


The Method 

A set of two hundred thu’ty-sevon statements expressing vaiious 
degrees of militarism-pacifism was collected from, several souices. 
These sources may be divided into three mam divisions. The literatuio 
on war and peace, statements about the issue of war us peace written 
by one hundred undergraduates and twenty graduates, and a number 
of statements devised and modified by the wiiter Out of the two 
hundred thirty-seven statements sixty-seven longest, least clear, 
and lea^t relevant statements were discarded Three professors 
and the writer then went ovei the icnmnu^ statements, and as a result 
forty more statements weie eliminated, leaving one hundred thirty 
statements for use in the experiment. 

Three hundred students attending the University of Chicago 
were used as subjeota. Among them weie eleven unclassified, eleven 
fieshmen, ninety sophomores, fifty-seven juniors, thirty-nme seniors, 
forty-two year graduate students, thirty second year graduates, 
seventeen third year graduates, and thiee Ph.D *s. Moat of the 
subjects wore students talcing elementary psychology Other depart¬ 
ments which also assisted weie sooiology, political science, divinity 
school, and education Only voluntary service was asked for except m 
a few cases when the instructor made the experiment a substitute for 
some class exercise. 

The presentation of the material was made in some cases by 
the experimenter, m others by an instructor. Generally the envelopes 
containing the mateiial were distributed first during the class hour 
The experimenter then read the mstmctions while the subjects followed 
him in reading then own sheets. Any questions asked by the students 
at this time were answered. The subjects weie then asked to do the 
task at home and to return the envelopes with the material ooraplete 
in a few days 

When the student opened the envelope he found in it the following 
material: A sheet of metiuctions, one hundred thirty statements 
each on a separate slip 5 ^ mches by inches, eleven index slips 
of the same size, each labeled with a Roman number I-XI, and a slip of 
similar size foi obtaining the necessniy infoimation about the subjects. 
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The subject was instiacted to lay out bcfoic Inin the eleven slips. 
He then was asked to put on slip I those statements which he believed 
express the most cxtiemcly militaristic opinions On slip XI he was 
requested to put those statements which he believed express the most 
extremely pacifistio opinions, and on slip VI to put tho.so which ho 
thought express neutral opinions On the lost of Iho slip.s ho was 
inatiucted to arrange the statements in nccordanco with the dogroo 
of miUtaiism and pacifism expressed in them. 

Only about seventy-five per cent of the onvolopes were returned 
This automatically eliminated some of the most caioloss indivKluals 
A few envelopes were ictuincd unused which was pichuable to a 
thoughtless and hurried performance. The index slips and tlie insti uc- 
tion sheets were returned in most eases and weio used over again w’itli 
the newly prepared sots of staicmcnls. 

The frequencies of judgments obtained from llic tlirot' liumhod 
students for each statement woro tabulated. Table I shows tlio fre¬ 
quencies of judgment only for statements chosen to constitute the 
final scale. These fiequeucics wciG then eumulatively added and 
the percentages of the total three huudi’od judgments det(*iinined 
for each of the lesiilting sums Three sample.^ me nhown in Tabh' II 
It 18 evident from the second column that statciiumt nuinbet 9 was 
put in group I (first column) by two hundicd fifty-four subjects. 
Two hundred fifty-four is 84.8 per cent of iho ilirce bundled subjects. 
Twenty-eight people put the statement in group II Adding twenty- 
eight to two bundled fifty-four, we got two hundred oighty-two which 
is ninety-foui per cent of thiee hundred. Seven people put Lius 
statement in group III. Seven and two hundred eighty-two is 
two hundred eighty-nine; that is, 96.3 per cent of the total numbei of 
subjects or judgments. Percentages thus obtained weie called cumu¬ 
lative proportions 

The same method of calculation was used for all the one hundred 
thirty statements Id order to show how this method applies to all 
kinds of distributions the three statementB, 9,10, and 8, wcic puiposely 
selected to represent thiec completely different distributions. .State¬ 
ment 9 was put by most people to the extreme left, statement 10 in 
the middle groups, and statement 8 in gi'oupa lying to the o\ trcinc i iglit 
Table II) 

Prom data such as found in Table II the cumulative jiroportions 
Were plotted against iho eleven groups or degrees of iiiilitariHin-puci- 
fism. Sample curves are shown in Fig. 1 Mililiinam-paciriHiu 
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A Srnlr uf .\tilU€tnMH~p{tnfihm 

was rcprc‘-(-‘iiU'(i iiii I)m' Im(‘ h.v tlip rlciTti Rmups running from 
cxtremrly iniiilnn^lu' Rumps (n oxtrcinoly imcifiHtic ones The 
cumulative prdpdrdniif. wen- Inculcd nii llie jmixw ruinnng from aero 
to one liundred. 

Sample curves iirehhdwn m I'lg 1 MiltdiriHiii-imoifiHm was repre¬ 
sented oti tlie lute tiy tin* fle\).n Rroupii niiimng from extremely 
mililnriatm groups lu extii-inely paeiiwlic mwn Tim cumulalivo 
propnrtioiiH wt-re lonPed un Hie y-axia running fiom zero to one 
hundred 



From ilie I'liries ilui" olihiiiied iwo Mihies were rlctoiniinedr 
The HOiile Milm* Mini (In* <|ii:ir(ile tlevinlhni. TIu) scnle value of a 
statoinenl was fotiritl a« f«dl<»wH .Siiiin‘n)i<*re on the chait tho curve 
mlcTSCCts the liftv per ei ul l»»*n/nni\l Ime, iluvt ik a lino running 
horizontally at the h vel Idiv per cenl ami at light angles to llie 
y-a\iH. Fioiii the pnmt «tf iiiti r-erlinri a line nan dropped at right 
angles to till* N-jiMfs 'rhe ptmii where fliiH line mler-.ects tho base line 
dcleiniineil llu* .H'ule \ ilue el Hu* sijileineiit The hcnie value of 
Btatement It) (see hig. U \s ishmiul tn he r»(liimhe<*ord(‘dou thcriglit- 
Imiifl side ef Mil* liguie A H|iiiil*ir pieeedure waa foll*>\V(’(l in finding 
the HPule value ef e-u h ef rlie eiii* Iiiiiiilied thirty Hlateirii'iits 

With Home of the eviieiiie rUufi iiH ntH, howi*vei, the curve did not 
roach the lifiv liei “‘iit hm* KMunjiles of llus may he found in 
Fig. I and Fig H. In kuoU c’lses Hi« curve was piojccLed at sight down 
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A Scale of MihUv iwi~pacifis77i 

or up as fur us the fifty per criUlme. Naturally, biich proectliiic la not 
qiiilo lib aceuiiile us whoii the ciiivc reaches the fifty per cent lino, but 
it 18 tho best ini'lluKl iwiulablc for Ibc extreme curves, 

Viiiiiibility of a Htatiunont was inciisured by the senii-mloiquartilo 
riuiKO or quaiLilc dcvitition, designated by Q The gioulei* tlie viiliio 
of Q, the 11101 e variable the statnmcnL, because people dieagrec more as 
to where the Hlateineiit belongo. Q value was obtained by simply 
reading off the range m the bane line concsponihng lo the distance 
between the two iioinbs wheie the curve intersected the twcnly-livo 
per cent and the Hevcnty-five per cent horizontal lines, and dividing 
this distance by two. The viviinbility of statement 9 was found to be 
0 2, the variability of statement 10 was 0.8, and that of statement 8 
was 0,‘l (see Fig. 1), 


Tiiij Scale 


i. Cofistvucluin —The next task was the selection of statements to 
coiibtituto tlu' final scale. Two major ciitona need for this purpose 
were (a) the scah* values and (6) the Q values All of the one hundred 
Ihlity statonieiUs woic aiianged first on the basis of the scale values 
in ascoiuhng ordoi, ranging between 0 5 and 10.7 Ncaily ovciy stop 
in this range ivus lepreHontcd by several statements of practically 
identical scalo vuIuoh. All slalcmonts of identical scale values woie 
arranged according lo their Q values 

It was decidi'd that there would be twenty-one stops in the Giitire 
scale, each step to be loprosentcd by one stalemoiit An additional 
stateiiKMit was to ii’pre.sent the origin. Approximately two etaiemonts 
were picked from ouch of the eleven gioiips. But m so doing the 
experbiiciiLor was guided by the scale values of each slftternGnt rather 
tliiin by tlio groups. 

In case of identical hciilo values Iho least variable statements 
weie picked as mensured by the Q value la a few instances both the 
settle vnluc'.s and the Q's weie identicftl Two minor criteria were used 
in cases of tins type. The brevity of a statement and the shape of the 
curve of it.s (hsliibution. A regular cuivc was profcried to a less 
regular one and a Hhort stateiuent to a longer one. 

As tt iCHUlt, u Hiuies of twcnly-two sLaloincnts weie obtained that 
woio about ('(|unlly spaced along the scale. The distance between 
two ndjaciMit sLatonicnts bcoined to the three huiidied judges, on the 
whole, as large as the distance between any other two adjoining state- 
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menis. In terras of scale values none of these dietuiicea wns larger 
than .6, and none smaller than .4 with the exception of the distance 
between the last two statements, which was .3. A second form of the 
scale was selected by examining the scale vnku's awl llio Q’h aRuin and 
picking equally spaced and least variable ytiiloinoiit.s. Twonty-lwo 
statements were selected to matcli the first form as nenily uh iwssdilo. 

The scale was readjusted on the basis of the froqucncicH of (Miilorso- 
ment obtained from, four bundled students. The fietiueuoie^ of 
endoiscment were cumulatively added, itnd caeli sura in one of tiie 
forms was compared with tlie corresponding sum in tlio other form. 
If one of the sums was larger, the stntemcnls were excliangcrl so as to 
balance the frequencies in one form with the frequencies m the other 

After the two forms were thus equalized the scores weio calculated 
for each and all of the four hundred subjects The distnliulion.s of 
the frequencies of scores obtained fioin the two forms are shown in 
Fig 2 

2. Descnpi?on.—Forty-four selected statoments constituted the 
main body of the scale in two foims. Thus each of twenty-ono stops 
on the scale was represented by a pair of statements One pair, the 
most extremely militaristic statements, represented the oi igin and were 
designated by 0. The two most extremely pacifistic staLemenls won* 
designated by number twenty-one, In order to assuio greater atten¬ 
tion and careful leading on the port of the subjects, tlio ataLcinculs wore 
arranged in random order. 'Written instiuctions wore found at the 
beginning of the scale. Attached to the scale was tho inforniaiion 
sought about those to whom the scale was given 

The instructions, the scale statements, and tho infoi mation bcction 
are repioduoecl below. In front of eadi statement code numbers au* 
found. After each statement in tho parenthesis Ihrco nuinbciH ai(* 
given: The scale value, the quartilo deviation, and the equivalent 
number (about double iiio scale value) of that statement. Tlio latter 
number was used in scoring. In giving the scale these three numbeis 
are, of course, omitted. 


A SoAlB OV MlLlTAmSM-PACIFISM 
InsliuclioiiB 

Tho purpose of this oxperimont is to moosuio diffcronoPK in oiimioiiH m'IiiIuiij: 
to peace and war Below you will 6nd a number of fltntcniciits cxinoHsmc vni ions 
degrees of opinion about imlitansm-paciflsm. 
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A ^>ralr of ^fli^f(l^l)lm-pacl/^sm 

It, on llio \\ liolf, > on w lOi Iho Aoiilimont of n fltntcmonl, mark it with a 
plu 9 sifffi in till' ii'in'nthoi'iH, 

If, on lht‘ \»\\ «U*<aRr<‘o wilU l\w RMUnnml of n Btatomenb, mark it witli 

a »nn«.s fij?n m llic par^'nlhf-ns 

Plciisf voU‘ for par’ll Ktaffmpnl pvoii if itercmB ambiguous and you bavo to 
make hoiiic wort of 

Only ina^‘« rrmilln mil ho imliliwInMl wliioh will not distinguish nuhvitlual 
ojiimoii. 

^taloinontA 

( ) 1, Mnlianrlt’fi iiro honofifod by loarning Iho lesson of war-timo cliscipluio. 

(3 0, (10, rn 

( ) 2. War in Ihf nioflern Morld iBoiinocdlesafta itissuicidal, (0.5,00,18) 

( ) 3, 'I'lioif iiulitnry nmlfl Hiiould he ratninod winch afford training to the 
body and tiund. (4 8« Q.G, 81 

( ) 4 Atmiv di«('i|ihno lupiroBBolf-rcapccfcandindividunUty. (8.0,0 0, 16) 

( ) n TJic loK'^OH m bunian lifo nnd property, groat ns they arc, are small evils 
eoinparoii to Iho umloriiiming of morals and the Ion ering of standaicls of 
(•nUiiro lunl oivihration enusod by war (00, 0,9, 17) 

( ) 0, Wars lire jnsfilmhlo only when waged m defense of woakci nations 
(.12, 1 1, D) 

( ) 7 ’\\'ar iH (‘miohlniK niid aliiinilntivo of the highest and best qualities of 
humnnknirl (1 0, OK, 1) 

( ) 8. IL 'he moral dulv of Ibo imb\ ubml to refneo to participnto in any "way 
in nu\ war, no inatler what (ho rniiflo. (10,7, 0 4, 21) 

( ) 0, Might IK right (0 R, 0 2, 0) 

( ) 10, 'J'ho most that we cuii hope to neeomplish is the pnilial elimination of 
war. (5 0. (IK, 10) 

( ) 11 The <‘vilH of Will are alighlly grentei than its benefits. (0,6, 0.5, 12) 

( ) 12. Until an l■(llllvall'ttt (liMipline is orgnnired wai must hnvo its own way. 

(K n, 1 0) 

( ) 13 lleoniiHi'riKlit may he more imiKirlnnt than peace, war may bo tlio lesser 
oftwoevilH (4 2. 7) 

( ) 14 Along with iinlnnliiiii woihUeiti/emiliip should bo taught in all socondaiy 
aehodlK. (0 0, I 0, 11) 

( ) 15. Perhoiis should pledge llieinselves never to aid any fiitiue war (10,4, 
0 20j 

( ) 10 U H iilmosL iiuitcivMble t<i lln^e a Inigo inilitaiy foice without bemg 
leiiii»l('d to iK-e lb (7.0, L 0, 13) 

( ) 17. Will JH I he tome of riees (1 5, 1 1, 2) 

( ) 18 4\'tieii file iie\t will bieaUout wo should tell tho diplomats who lead us 

Id it llml, \;e will not follow lliem (100, 11, 10) 

( ) 10. MililiiiiHiii ifi lure'-'uiv foi the pioper defense and piotcction of the mdi- 

viduals of II (’doiitrv (2 0, 1 0, 3) 

( ) 20, .So long iiH iiiiv people, while, blnek, biowa oi yellow, hold weapons m 
llu'ir liaiidH, we must not eoniiiul tho folly of disiuming, (2 6, 1.0, 4) 
i ) 21. Umlei (liewoiiigeofwiiraiiiilioiihnHnooppoituiiityforciiItuialdmlop- 
riK’iit (8 4, 0 0, 10) 
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( ) 22 Tho (soldier suffcifltrcmcnftou‘«ly ami Kaim very liLllo (7 0,10,14) 

( ) 23 The evils that brings in ili Irniii fur oiiUvcikIi nnv pon'iiblo boiiprUa 
{8.0, 0 9, 17) 

( ) 24 Wo should have a moderate Mno\inl of IrmimiK m o\ir hi'bools, 

(4 4, 0,6, 8) 

( ) 2d. No scliomo of nggiessjon 01 * coiKiuost can be piirHued for nnv conHiilciabh* 
lengthQftimowLthoutenfeeblingvictornswpIliisvniiriiiiHhpd. (7 4, L 1, 
13) 

( ) 20 When war tlirojitcns we hIiouIiI rofuso llie nil! lo H(‘r\!('('find iiion'iisp our 
anti-war activity (10 6, 0.7, 20) 

( ) 27. It IS foolish to talk of the Abolition of nnr, ftiiioe jnignnritv is /in ineriKlicn.. 

bio human instinct (2 6, 1,0, 4) 

( ) 28 There is no piogrcsa without wnr (0 0, 0,7, 0) 

( ) 29. Militaiiam should be abolished from Iho eiirnruliini of the slnti* schools 
(8.4,11, 16) 

( ) 30 It isnotiQ war but m peace ntid iirospciitj llmtoiir worst vkps develop 
m\ glow rank (21, 1 1, Z) 

( ) 31. Wo cannot hope to do awav with wiu, heeniise il is port of the niieiulmg 
stiugglo foi 8111 viva! in a ciowded woild (2.9, I 1, 

( ) 32 If aimed conflict between indiviibialH iimi <ilies fsin he oullawed, it is 
possible to outlaw armed conflict between milioiis (7.8, 1 0, M) 

C ) 33 Every war sliow's cowaidicc, iimitlci, niwm, giafl, iiiul leii\ es u trail of 
pcuonal and national dcinoialiration. (1) fi, I 0, 18) 

( ) 34 The most frequent cause of wnr w Ibc iiviib i of iintiojis foi posseHSKin of 
tci'iitoiy, marketa, conccaHionn, and splicres of iii(liieiief> (.9 i) t), JO) 

( ) 36 Tboro in no conceivable piBlifieation for wai (10 7, 0 7, 21) 

( ) 30 Mihtniy traimngisimpeiativo.biitifcBlumld lie vohiutiirv. (4 1,08,7) 
( ) 37 Nations should agioc not to mlerveiie with niilitiiiy foit‘(’ in purely coni- 
incicial or financial disputes (0 3, 00, 11) 

( ) 3S CenccYiung war we Wttislr bo aboUUouwts. (109,1.1, 19) 

( ) 39. The abolition of war would moan cfroiiunney, softnesH, debilitation, ami 
degcneiacy (1.0,10,2) 

( ) 40. A host of young men ontcicd the wai lu a spiiit of ulivilisin and unselfish 
devotion to a groat cau^o, only to icturn dimlliibioned and eyoicul as to 
the value of idcfilfi (8.1, 1.0, 15) 

( ) 41. For the liberty of oppicbsed nations waia slioiihl bo fought (3 4, 1 0, 0) 
( ) 42. Compulsoiy military lintning should bo esttihlislicil in all couiiLiies 
(1 0 , 0 . 0 , 1 ) 

( ) 43 Pugnacity, uvalry and sclf-intcicst arc naluial, but need not lesult iii 
wai any inoio than humnn desire foi dominance need result iii slnvi'i) 
(8 8 , 11 , 12 ) 

( ) 44 Peace and war aio both essential to progicHs (6 4, 0 (i, 9) 
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.1 SrnU' nf pacifism 

Nanip 

Clasfinnitu'U tlun' ojip i 

I >ltiii!in Juiiirii (InidiiiUp 

Nn>)iiiiiif»rc S( mur 

Fcx (iiiulpriiiii’I'i'insli' 


8. ,Srori)ni I’cir M'nrinji; nllicr (Iio oiiguml ycalc values or the 
cquivjilenl, jjuiuIhtk iniglit la* In lliiH expenmonb for the pur¬ 

pose of yiinpliljcatu'ti juul lll•(•uUH• (lie oiiKiiml hculc values wercfahly 
cveiily iliMtnlmfiMl, rinn\i‘li‘ii( immliers were used as abnsisforscoiing 
The score was llu* iivciagiMif llie iMpiivalent numlH‘rs of the statements 
narked plus 

>1. HvhnInlUi/. i'«*r calrul iticii of tlir lelmbility of the scale 
Ihomolliod of fonii eoin|iiiij‘-oii wii^rlmseji. l'’or this purpose the data 
obtained fioin four hniidn-tl studonfs (i-ee applicaliou of ecale) wore 
vised. To coindute iho lu<i fuims tlu' product inomciit cocflioiont of 
conelulinu was T’ho eonidtilnm was found to be -1-.83. The 

Sponninoi-Hrowii fonimln when niipluMl In tins gave a value of +.90, 
which iH lli('«’\pe«'li’d eorrclalitni nf I he luo foiinsif conphitod with two 
other forms. TUo lador ecirjclaUon \s Ui be icgunUal uh the reliability 
of the total hcaie ax n^etl \n uh application. 

AiU’Mc'AI ION 01 'I'lll. ScMiO 

The (MinslruettMl hcah* was guru to four hundred sUidonts attending 
Ihc llmver.-'ily of t ’loeago 'Phi' four bundled sludonls included eight 
freshmen, one luimlred ilnrl,v-‘'i\ aophoinoie.s, nincty-six jimiois, 
8ixty-Hi\ Mriiorx, laglify-ilin’e giiuluates, and cloven unclassified 
students 'J'he ages of iIichc subjeots ranged between seventeen 
and forty-four, ibe ii\«rage bung 21 S Scores on the scale were 
stiuIuMl in r<*l'i(i(in l(> foui factnis' ImIoouIioii of atiidents, sclioluiship, 
sex, and idnueb alhlialinn 

1. Kdufdlnm ofStudtJd'i '1 lie four hundred lecoids weio airangcd 
on the liiOiiM «(f i)u* i dni’iilimial alatUH of eiieli Htiideiit llccords of 
frcHhnu'U won* put in um- guuip, u'eoidn of yophomcnes lu anoLlier, 
luid HO on. All III all, live gioups uore obliiined The types of groups 
and tlie nuniber of at inlonN iii I'aeb aie .‘^liown in Table III. Tor each 
of the groups an aveiage of llio i-eoieH wiih then calculated, also the 
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standard error of the average, and the standard deviation of Llio dis¬ 
tribution of the sooros. 

A tendency may be observed \n the bucccrsivg difforcncos between 
iho averages of the Hve groups. If taken scpaiately they are liardly 
of any significance, hut when compared one can oliscrve a certain 


Table HI 


No 

Clnss 

N 

Mean 

RCOIC 

(7 m 

<r 

I 

Freahmeu 

8 

11 23 

71 

2 02 

U 

Sophomores 

130 

11 32 

2(1 

2 

III 

Juniora 

00 

11 flfl 

2(1 

2 0.) 

IV 

Seniora 

00 

11 03 

2S 

2 :io 

V 

Graduates 

83 

12 82 

23 

2 10 


definite continuity from ono group to another. These dilTercnccs all 
run m the same direction, which indionlos a toiulency toward greater 
pacifism as education increases. This incroaso \n graphically leprc- 
sented in Fig. 3. 

The second feature of tho differences is their gradual inorease. 
This function, somewhat magnified, may also bo seen in Fig. 3. A 
curve drawn through the averages appcaia to bo postivoly accelerated, 
the scores ranging from tho mean score of tho freshinon cIubs to tlio 
mean score of the graduates. 

These results tend to indicate that education has something to do 
with the formation and modification of altitudes towaid war and peace. 
With, educational advancement students tend to become moio favor¬ 
able to a peaceful way of solving international differences. This 
general trend is seen m Table III and Fig 3, according to which there 
IS a continuous change in attitude toward pacifism as the students 
advance m the college to the graduate school. 

2 jSc/iolars/iip.—Scholarship standings were obtained fiom the 
Bureau of Recoids for two hundred twenty-seven students. The 
undergraduate grades were expressed by the number of points. Bui, 
the graduate grades had to be converted lulo numerical values by the 
experimenter This was done os follows: 11 = 0, P ^ d, U = 1, 
Inc = 0. An average score was then calculated for each individual. 
A range of .60 to 6.50 in scholarship values was obtained. The 
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Pearson cocfllclcnt of coi'ielation between the scholarship values and 
militansin-pacifisin was found to bo -f-15. 

This low correlation seems to indicate that there is little or no 
relation between bcholarship and militarism-pacifism If there is 
any, then Lliero m a sliglit tendency for pacifism to couGlnts positively 
with scholarship. Students of higher standing m scholarship tend to 
1)0 pacifists. 

3. /SVi ---Among the students tested two hundred twenty-five were 
inon and one Imndicd scvcnly-fivo women. The average score for 
men was found to be 11 6d, and for women 12,30, the dilTerenco between 
the two being .70 The standard error of the difference was 20, 
which is less than a tliiid of the difference. This indicates that women, 
on the whole, are more paeifistic than the men. The extent to which 
the two groups overlap may be seen by comparing the two distribu¬ 
tions in Vig 4. 



It is also ovidont from the figure that the distiibution of the scores 
of men is wider than that of Avomen In terms of the standard devia¬ 
tions the vaiiabilUy was found to be 2.30 for men and 1 98 for women 
Women appear to be in bettor agicement regarding the issue than men, 
and thcie appear to bo many more militarists among men than among 
women 

4. Church AffiUatwn.—'Uaio, on church affiliation were obtained 
from the university files. Ten denominations having the laigest 
iG))roflontation weie selected for study as shown in Table IV Por each 
an average score was calculated, and the denominations were then 
arranged in descending ordci 
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Twi.k IV 


Denomination 

CiiHi’s 1 

Mean W'o! i* 

Diseiplca of Chrmt 

0 

13 0.') 

Baptists 

11 

12 ri7 

Jews 

3!) 

12 'll 

PiesbyLenftim 

‘21 

u Mr. 

ConKrPBfitioiiftlinl*J 

11 

Jl 02 

MothodisW ' 

2-t 

ll 40 

Chnstmn Spionlisls 

8 

U 42 

Cfttliolics 

H i 

U OS 

Luthciaiia 

7 

10 1)5 

Epiacopnlinng 

14 

10 (K) 


The numbei of caaca in each denominational Kroup not largo 
enough to 'watraut any definite conclusions, but Lho i osulls arc intcicst- 
ing and suggestive. The most pucifisUo churches may ho found at 
the top of the list and the least pacifistic at the hoitoin. 'J'lie Unco 
churches most similar In form, the Catholic, Lutheran, and Uio I'lpisco- 
pahan, seem to bo altnihr m attitude and occupy the lowest three 
positions That is to say, they tend to bo tlio most inililiinstrio 
denominations of all the ten. Disciples of Christ, Baptists, and Jews 
stand at the top of the lank order; Proshytciians, CongiORiitionalistM, 
Methodists, and Chiisbian Scientists arc in the inid<Uc 

CONCI/USIONR 

The following brief conclusions may be drawn from the expf'rnnciit 
described in this article: 

1 By the use of the method of equal appealing intorvahs it wns 
possible to construct an, evenly graduated scale of nuUtaiiBin-pacifism 
The unit of measurement was one-olevciitli of tlio riiiigo of iittitudn 
between the most exticmc degice of mihliinam ami the moist oxtiemo 
degree of pacifism represented in our list of stalcinciUn. 

2 The reliability of the scale was found to be 

3. Education appears to develop pacifism ub inciismod by tlio homIo. 
A consistent change toward pacifism was found for tlio hucci'hhivc 
undergraduate classes and tho graduate* classes. 

4. A coefficient of correlation of + 15 was found bctwi'on niih- 
tansm-pacifiam and scholarship. 
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5 Women appear to be more paciBstic, on the average, than men 
Men vaiy more tlian women 

6. Tlie Catholic, Luthcian, and Episcopalian seem to be, on the 
average, the least pacifisLic churches of the ten compared. Disciples of 
Christ, Baptists, and Jews appear to be most favorable to the peaceful 
method of solving inlornalional problems. 



■WIIA.T THE TIIEOllY OF 


FACTORS IS ^'l)f 


G vSPEAUMAN 
XlnivctMty o( Txindoii 

Not long ago there was held a very novel and Miccc'-f^ful plioUi- 
graphio exhibition The pictiuca aent iii weic not iih usunl llio 
but the most instructive. Among them weir those got fioni undor- 
exposures and from ovei-exposuics; ihoso whoio the ninticiHuni in llio 
developer had been too long, and wlicrc it had boon too shmt; whoi n 
the focussing had been faulty, and where the cainem liail been Hhalccu, 
wheie the lens liad caused flaic, oi ihc bellown hail not lieiMi light- 
proof; whcie the printing paper had been stale, or not of a Hiiitablc 
kind. In a word, ihc pictures suffered from the thouHimd and one 
ills to which the photographic art m heir The Ricafc uloii of the 
exhibitors was, of course, that their own iinforUmnic expeiicnces 
should serve to warn otliorfl, 

Now, if not too presumptuoufl, I would like to suggest Unit a some¬ 
what similar general service might be afforded by a book wlncli has 
lecently come fiom the assembled strength of the pHychologioal dopai't- 
ment of the University of Minnesota, ns lopicsenteil by ProfcHHors 
Paterson, Elliot, Andei-son, Toops, and lloUlbiodei; a voluino, more¬ 
over, fortified by tho unstinted linnneial support of the National 
Research Council ^ 

Taking first tho historical aspect of lhi.s woik, we au* told in 11 
that the theory of two factors was not "denintoly advanced" till 
1914, having previously been only "implieil." Now', if Huch an 
unhappy account can befall the distinguiahoil symheatu, 

surely there must be many others who arc not fpiile clear on the inal (or 
and would gladly be informed. In truth, the very fust publication 
about such factors (this was ton years cavUei than the date, mentioned 
above) supplied perfectly definite obscrvnlionR and at llio hainn time 
a mathematical criterion so exact as to lie Hubslantially Lliat used 
at present. The chief final conclusion of the whole work lan (in 
italics) as follows; 

All branoliGs of intellectual Activity Imvo in cnininim niu* funiiimicjilfil fuiuif ion 
(or group of functions), whorcaa tho loinaimna ov hiicciUc I'knumtH of llw ivctvviLy 
seem m every otiso to bo wholly different from that in rill Uki oUim nuhOH « 

Anything more piecise I, for my part, ooiiUl liai’dly foiimilatn 
to this day. Further, not only weic thoau two fnolom, // and s, 
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explicitly pioclanned, even their veiy influences were actually dis- 
coveicd and ineaHuied Wlml is still moie, iliis oiiginal publication 
already drew Uio pniclicul corollary (which wag ho biilhantly exploited 
the follownig yoai by lliuefc and Simon) that the g can actually be 
inensui'od, tliia is dono liy thiowing together any hotchpot of tests so 
niirncrouH and hoteioKoneous that, on the whole, the influences of 
the a's lueie or less i>ei*feclly nculrahzo each other This, vital 
coiolliuy was indicated by the vciy title of the article, ‘“General 
Inlelligenoo’ Olijoctivoly Dctcimuicd and Measiued." 

Incomparably more imporlaiit, howevci, than any such mere 
histoiy of the doctrine of two factors is the exposition of its essential 
nature According to the authors at Minnesota, tho basis of the 
doctrine is “simplo enough”, Ihcir chaiactcrization runs as follows. 

It is rommonly nbaiimod that a perfect hioiaichy creates stiong picsumption 
tlinb a goiioral fiiclor ih at wink 

For ventilating this view wo must be more grateful to them than 
cvci, since it not only departs from the actual state of affairs, but 
turns it upHido down and msidc out. In truth, no “assumption” 
01 “picsuiniition” has ever been made at all about the occunence, 
01 oven iiicaHiirabihty, of tho g and s Instead, iigoioiis pioof is 
given that in the said cage of hierarchy (more strictly speaking, 
“oqui-proportionahly ”), and solely m this case, the scores in the tests 
or othor vaiuibIcH can always be divided into tho.se two factors.^ 

IVhat IS the good of this, il may bo asked? Toi can not the teals 
equally well he divided after any othor fashion? The answei ivS to 
concede tlnit, so far as the matlicinatical theorem goes, othei modes of 
division—perhaps an infinite numbei* of them—certainly are possible 
But yet otlicva, and extremely impoitant ones, are not possible. Thus 
the Leals cannot possibly (wheio tho criteiion is satisfied) be so divided 
as to admit of any gioup factois (of appreciable size). Again, the 
tests can not possibly be so divided as to have any general factor 
othei than our g Hero we notice that, although the theorem does 
not in itself supply any evidence that the g deserves the title ot “intelh- 
gonce,” still it doe.s dispiove the existence of any olhci' and different 
gonoral mtoUigcncc Of course, lUcrc may be other mental operations 
that anyone may like to call “intellectual.” But then these can, at 
mo.st, only constitute cltisaes. They can not possibly be genoial 
m the sense of having functional unity 

The furtlioi question still remains open, however, as to why we 
should give piofci'encc to the division into g and s ovoi any othei of 
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iho modes of division that the said rnaUicmaiioal llicoiein really Idocs 
leave open A facile reply (but quite correct, so far us it goei^) is 
that this mode of division is the simplest. Ihit penelmtinK iiloic 
deeply mto the essential chaiactcr of cmpiiicul Hciencc, we may answer 
with greater bieadlh that ihc.se two factors liavo liillit'rlo sliown Ihiuii- 
selves to be those divisions about which iho most impoilaiit stalonuMils 
and discoveiiGS can bo made. To mention only a few wo shall hoc 
many more later on—it was in g lliat llic inapnalion leally aioM* foi 
all the curient tests of "general ability/’ or oven of "inontal age", 
only in g do all these tests to this hour find any slnblo anchorage amid 
the shifting sands of tho aibitary and gieen-lahlo conoiqitions of 
"intelligence", and with lespect to oiir factors alone can bo moaauied 
the scientifically indispensable "probable cirois " 

Another object lesson is niToidcd by these autliors at Mnmosota 
when they embark on the tioubled sens of contiovcihy. Hut lioie, to 
speak with frankness, they give some occasion for suipiiso. Tlioy 
bring against the theory of two fnctois the following pair of objections, 
The one is that the inter-correlations between their tests liavo tinned 
out to be low Suroly wo might have expected much les.s eininiMit and 
careful authoiibies than these to know at least lliat the theory is in no 
way based on the absolute magnitudes of the conelutums, lie tliesc higli 
or low, but solely on their latios to each olhei. Tlie bccoikI oiijection 
raised is that in their results the ciiteium of "intcreolumnar coirela- 
tions ” did not average +1.00 But here thoir luck was out altogether 
A look at the woik which introduced and demonsiraled tliis cnteiion 
will at once show that they have used an ontiiely wiong foinmla,' 
that, moreover, they have applied this inuhn conditions that would 
rendei even tho right formula (pnlo iiiapplicahlo,'’ and yob further 
that the whole oiiteiion was from the very beginning deelau'd to be 
only provisional and hns now become quite obsolete ® 

To crown all, even if they had applied the piopei ciilciion and had 
obtained similar icsults from this also (as tlioy would actually have 
done, for in this case the many wrongs end by making a right) even 
then those results would have been no coniradiction to our work 
Tor in this particular case of theirs, oui woik hliows that the cnlmion 
ought not to bo satisfied. 

This brings us from tho piecoclmg negations of tho Almncsota 
investigators to their positive contributions. Hcio tins lesson at issue 
is the delicate one of clislmguishing between meum and Imm. In 
the first place they lay claim to have advanced the general hypoLlu-.sii 
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of objcctivi'ly dotoiiniupd “unique tinils"; whereas it is hard to see 
that those arc anythuiR more than the old factors camouflaged iindei 
a new naino. And in the flceond place (and it is the ihemo of the whole 
book) they H'pvcsout themsolvcs as having discoveied the “unique 
trad." of “ nKicluuucnl ahddy wlioieaa in truth the latter had ah eady 
been discovri'od (imd with what 1 m\ afraid was far bettor evidence 
and moic poiu'tnitmg (uuilyflis) by Dr. J. Cox, who moioovci succeeded 
m so doiUK by basing tim resoavch on the tUcoiy of two factors.’ 

Poiluips a duo to the last monUoned and gravest lesson supplied 
by Ihc-se iiufchoi'H is to bo found m tliou bibliography Most concerned 
hove 18 a book of the present wnlev, "The Abilities of Man," As 
was said in its foiewoul: 

I'liiB work 18 the pioduct of iimny handfl and muoli pnticnco Tho lines of 
investigation \M'r<* suggi'^ted—and even cvtcnsivo bt^mnmgs made to follow tUem 
lip—over twenty yiMiis ngo. Kmcc, tlioro have been caviiod out a long tiain of 
Jfthorioiis I rsciii dies, eiidi hi ingingt as il wore, a single stone upon a prc-concoived 
plan. And here, in tins > oliiino, at Init, oveiy stone is fitted into its placo to build 
up tho common odifme. 

Among other things, the book contiiincd a full account of this very 
moclmnicftl ability at i8suo. Nevertheless, aUhougli this book is 
actually quoted in the bibliugiaphy fiom Minnesota yet its most 
relevant iiorlion is wholly overlooked. The authors insert theie the 
oddr.st lot of tho Hiinio wnlei's minor controvoisial aitides 

Now hiieli action of fcheiiH would Rcein to express a view that is hold 
very widely indeed, so lliat once inoic wc must be grateful for the 
piosent opportunity (o eoinincnt upon it. This view is to the effect 
that tho work of our school has consisted in arguing on behalf of some 
highly conliovei’sial theoiein, and Hint tho only concern of other 
people with it IS to join in Hie fmy, foi or against 

In tiulh, the work of Hus school may bo trenchantly divided into 
throe poi Lions. The one which .should be taken first is made up of 
thcoicnis whicli ai e no longci senously conlested by anybody There 
is the already nHuilioned piiioly ninlhemalical demonstration that, 
when the tetrad diheienees nic zeio, then (and only then) the scores 
of evciy indjVKlnal in every lest enn be divided mto p and s where 
these are indi'pt'iidenl of each olhei ns also of all the othei s’s Then 
comes the deteinumiHon of Hie piobable eivors, not only of all these 
but also of the tetrad dilleieiices, h\u we yeiiunc to know how huge 
their diffeionci'H ought to he when, us always happens, the data 
available aie not the “true" coriolations, hut only values moic oi lesi 
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affected by the errors of Bftinplinp; Another lliooieinj this time 
obtained not from mathematica but from obaerviilion, ih lluit under 
some conditions at any rate the obseivcd tetrad dilTeionccs do kIiow 
themselves to have just this mngnitudo icciuiied foi the two factors. 
So much for the portion of the woik that should be lakoii lirst. 

The portion that should, on the contrary, be taken last dciilK with 
the attempts to arrive tiiuHimaleexplanations; it inoludoH, (or ovaiuple, 
thehypothcsisthatjyicpmaentsagcncuil ''cneigy." Hero, indeed, aro 
problems that will long—-pcihapfl always-be iiifeoled inoio than 
enough with "picsumpbions and assuinplions/’ Nothing but trouble 
can be expected from even approaching tlicm until after arraying and 
considering all the available relevant facts. 

Thia brings ua to the remaining and much tlic largest part of our 
woik, the one which, accordingly, occupic.s tlic great bullc of "Tho 
Abilities of Man,” constituting its second part, and ent illotl Tlio Funda¬ 
mental Facts. Here, ns mentioned above, are lecoidcd an inuncnKo 
mass of observations untiringly accumulated by very nunioroiiH investi¬ 
gators during a great number of ycaia One huge aliavc of these 
observations is about the conditions under which tlio criterion of totiad 
differences is or is not satisfied. Already in 1000 Ihe (liHiiovery had 
been made that such satisfaction was liable to bo disturlxal liy what 
weie called ‘‘broad” gioup factors.* 

Those too have boon made to yield both inoamnemMUs and tlio 
probable onors of these. Among the more important that have (by 
means of the probable erwis) been shown to bo sigiuficunt aro tlio 
logical, psychological, verbal, arithmetical, and inventivo abilities, as 
also just the mechanical ability now lioing pul forward at Miniiosota as 
new. 

Much broadci still, hut no longer simply an ability, HOinolliing 
rather that depends on ratios between abilities, have come the facLovs 
0 and the still more wonderful p (sometimes written as c). Hardly 
less important have been the negative results oblaiiiod in this way, 
the evidence has been that the great inajoiity of the commonly alleged 
unitary abilities, types, piofiles, and so foitli arc not imilai'y at all. 

All such factors are originally dotormiaed in an almost [lUKsly 
statistical manner and therefore are psychologically Hourly inoaning- 
loss. But then come obseivntions that do mfuao them with nuuuuug 
The relations of all of thorn have boon ascertained to all ilio qualilativo 
laws of cognition; and in thia way the “uoegcnotic” iiatuic of g hiis 
been settled, not by biological or philosophical cogitation, biitj^by 
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actiml ftiicl clotailed mpaauremeiU'5 of ita magnitudes and correlations 
under vniying coiulilunis At the same time, investigation has been 
made of the inhition of all ilie.se factors to the quantitative laws, to 
thoho of span, of retcntivity, of fatigue, and of conation, as also’to 
piucly physiological iidluences. Fiiitliornioio, fiom all this systematic 
examination of the spheio of cogiiUiou, a passage has been found over 
to the other gMUit sphcio of the niiiul, tliat of volition, emotion, and 
chniactoi. Ileio too u gonoral factor has been discovered, one nearly 
or quite mdepeiulcia of (/, and perhaps even more irapoifcant still 
Tlioso ohseivatimiH aio, indeed, so piesonted as to throw light upon 
the facloiH involved, gonoial, specific, and group But they stand 
equally open to heuig cnvibaged from any othei angle They do not 
m the least dopond on any such liypothesea as that of "energy," but 
on tli(‘ coiiliMiy hupply tlio very facts upon which such hypotheses 
ought to 1)0 aocopled or lejotitod. Thc'io observations should not, I 
like to think, lx* ovcrlookinl by any one mlorcsfced in any sphcie at 
any iiitn of jndividuul difTeiencos They cannot legitimately, I feel 
BuiP, be dmu'guidiHl by ihoso who lay claim to oiiginal discoveries 
Leant of all ougliL tlioy to he ignoiod liy ilioso who make bold to enter 
into I he liHl.s of oontroveray. 

Ri')Fi;ui')ncj1':.s and Notes 
1, 'SMiiiuc'iotft Mi’cliiiiiicitl Ability Tests" 1030. 

2 "(h'lWial TutelUgeud* (ibp'tttvvulv ncteiiiuiu'd luvd Measured" Amciiiaa 

Journnl nf Psiftholoyy, 1001, p 

3 Posilive pKKiI will be foiiiid for iimlnnyi*, on pp iii-vi of "Tho Abilities of Man" 

by tho jaeseut w’ritei, 11)27 Tins dciiionaliation consists tluoughout of 
fitrftiglilfoiwiiid iimllieiiiiilii'H; tlieso is not an nssiimption or presumption 
from end to end. For tliOh(‘ who Jnid tho inatliematics in it diiricult, ifcmay 
1)0 inrntioiiod tliiib a iiiuoli siniplor voisioii of it has boon clovigod and will 
shoitly be publmhed (m "Natuvft") by tho well known mathematician, 
Piofessor I’iiikkio 

4 Jiulish Jouru/d oj Pt^i/c}wln{iy, Vo] V, U)12, p 82, formula (8) The simpler 

formula oinploved liy them taken no account of the dominant iiifliiencG of 
tho sampling oiiois of tlic couelation 

5 Ibul P fid, the linen ui italicH 

0 "The Abilities of Man " By tlie piOKPiit wiitci 1927, pp 138-140 
7 "Morlmmi'id Aptitude " ,1, W ('o\, 1928, MetUuou imd Co 
3 Diu KoiK'lalmn /wihclien vi'rseliii'doiien Roistigeii LoistungsfivbiKkcitcn 
Zcituchnjl Jiu XblV, 1900, j) 103 



A REPLY TO SOME RECENT CIUTICTSAIS PY 
PROEESSOR SPEARlilAN 

31. D. CAUTEll 
UmvciBity of Minnoholft 

SiGCtJ sGientifio eonfeiovorsies fipqiicnlly Ji’ml lo clnnlicalioii of 
ifiBueSj a comiiiGnt on Piofcssor SpcaimiuPf^ rocrnt oiiiicihinK* of iny 
attempt to analyze tlic nature of mochamciil al)i!ity' may he m ciulor. 
His mam criticism was directed nRauiHt niy w of the ml orcoluiiimii 
correlation method as a eutcrion fov the jiro^^enee of the famihiu '' two 
factors," g and s. He oharactcrizofl this method «h ol)solctc, yet in 
his book, “The Abilities of Man/* on puRo 1311, ho has iv Uddo of twenty 
senes of data which wgi’o tinnlyzed by this inolhod, and tlie resuUs 
were used in support of his theory. TKia BURResls tliat oven thougli 
the method may now be labelled ns “ohsolote," ncvcilhelo.ss iL la 
peimissible to contimio to xopoxt rcsuYl'i fiecured by that method 
furthermore, it is to bo icmeinbeied that the iicwor leluul-differoncG 
method of analysis mathomalically cxpics&Os the Hiiine fundnnieiital 
relations. In my own work I recognized this fact unci aceoidingly 
analyzed my data by moans of both methods, diacovoring tluiL tho 
trend of results was tho same. This wa.s mcviinblo in (lie very nature 
of things. Since I employed tho tetrad difTercnce luetliod in addition 
to the intercolumnar corrclalioii method, I do not believe Unit Pro¬ 
fessor Spearman was justified in liia main cntioiKin 

Mr Spearman also criticized niy work by Htating (hat my tallies 
of correlations did not satisfy the only coiwhlion under winch the 
intercolumnar criterion is applicable. It is tiiio ho luis a on tenon 
for the exclusion of ceitam pairs of column.s, wliicli is ailiiLraiy, and 
not wholly free from ciiticism. After rending Thoinp.son’H niatlie- 
matical criticisms® of the "exclusion crilenon” I dul not regaid this 
criterion as essential, but I decided, novertiiclcas, to apply it to iny 
mam table of intercoiTelations. It was my misfortuno, however, 
to take this ciiterion diiectly fiom Professor Spcaiinan’a 10 Id paper, ‘ 

’ Speaiman, 0 A Tiuce to “Baiking in.” Journnl of ISducnlwnal Psychologg, 
Yob XXI, 1030, pp 110-111, 

* Carter, H D.‘ Tho Organisation of Mcclianicnl riitclligoncc. JouiiKtl oj 
Genetic Psychology, Vol. XXXV, 1928, pp. 270-285 

® Thomson, G II.. On ilio Dcgico of Poifcction of nioruroliicul Oulcr among 
Correlation Coemoionta. Bimetnka, Vol XII, 1910, i)|> 3515-300 

*Spearra.an, C : The Theory of Two Fnclois. Psycholoffiml Rcuiew, Vol 
XXIj 1014, pp 101-115, (Soepftgoll2) 
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1)1 which li(i hniiHclf nnsstalcd il I should have secured ilie method as 
coiTcclly staled l)y Spearmnii in his 1912 paper ^ The cnterion, 
therefoKi, was improperly applied, which led to my incoirect statement 
tlmfc all GoliinuiH of my Table III satisfied it But leccntly, after 
loading Ins onlicisjn, I applied iho cnterion again, Una time correctly. 
Of llio eight columns in Table III, foui satisfied it, and four did 
not The av('iag(' coiTelatmn between all columns in the table was 41. 
The avoitige of the six intcrconclations of the columns which did 
satisfy the cntoi ion was BD. For all othci pair-s of columns the average 
uiLorcorrokiiion was ‘12. Correct application of the cnterion is 
thus shown to have no important bearing on the results. 

Profcssoi ypoaiiiuin also criticized my paper because Ins own 
lefciciicos to one published article and to two unpublished reports 
in his “Tho Abilities of Man^' wore neglected Ho claims that those 
invcaligtilions reveal inechuiiical ability to be umelated to g and to 
involve a group factor But my niinly&is showed oveilappmg group 
factors. It IS to be noted that my results differ from those quoted 
by Spearman in Ginphiisiiiing group factors rathoi than a group factor, 
'rims it would appear that the Minnesota Mechanical Reseaioh 
Project inako.H an additional contribution to previous knowledge 
dealing with tlic alnlitios of man ^ 

'Spcarinaii, C. mid Iliut, IJ Gciipial Abilily, Its Existoncc and Nature 
linlish Join mil of Vh^Lhohgtiy Vnl. V, 1012, pp. fil-8‘i. (Suo page 50) 

“PfitciBon, 1). (i, Elliott, 11 M, AndeTSon, L Dowoy, Toopa, K A., anti 
Uoidbrcdor, E “TIiq Mcehamcal Ability Testa" Univeisity of Min¬ 

nesota Pres'), litSO, pp. 1-01(1. See e-^pecmlly Chapter II, The Theory of Unique 
T'rnitfi; (Jlmptcr XI, 'fhe Oigimi/ftlion of Mcehaiwcal Ability, Cbaplev XII, 
Mcohanieal Ability m a Uiinjuo 'Trait 



STUDIES IN HANDEDNESS: III. KIOUATION OF 
HANDEDNESS TO STEECII 

II, II OJKMANN 
iStutc Uiiivpisih of lowii 

In Una aiUclc data will be pi'Cheuled icUilivu to Uu' pioblcm ot Iho 
efiect pioduced upon the Hpoeeh function by InuniiiK h'fl-liimdLMi 
children to write with the iifiht hnnd For iJiiH i^v(■‘^tl^^!lllon two 
gioups of subjects weio used. In the uiiheleetcd group of five Imndivd 
eighteen pupils used m the invrsligalion rcporti'd m lh(‘ first articlo 
of this senes of studies in handedness there weie twenty-seven pupils 
who weie diagnosed to bo lofUiauded by Iho lochuKiue deseiibcd in 
the fiist papci Seven of the twenty-seven ciiseH wrot<‘ with tli(‘ iiglil 
hand These seven cases constitute the first group of dexlro.sinistral.s' 
used in the piescnt mvesligulion 

The second group ol dcxti’osiniHlrals was olitaincd as follows: 
In the city from which the random Riimplo of five lumdred eighteen 
pupils was taken from Gindos III-VIU Ihero was a total luimber of 
1671 pupils in these grades. It was iissuuied that if (he names of 
all the pupils who performed one or more of such aetivdic.s as using u 
pair of scissors, throwing a ball, and dealing cards weie olilaiiK'd, 
several doxtrosmistrnl oa^cs would bn w'curi'd, Accordingly, each 
teachci' of Grades III-VIII was askftd to inako. tUvee tisU of luuuos; 
(1) A list of the names of all tho pupils who used a pair of hcissors with 
the left hnndj (2) a list of Iho names of all the pupds wlio threw balls 
with the left hand, and (3) alistof the immeB of thu pupdH wlio tlumglit 
they could deal cards bottei with the left hand liian with the right 
hnnd. The purpose of this request was made clear to each Kuicher 
It was pointed out that it was desirable to get all the pupils who uaotl 
the left hand for the activities mentioned; and that, tliorofoie, the 
teacher should include all doubtful oases. It was explained that it 
would make no difference if too many cases were repoi ted, aiiico each 
case would be carefully tested It was also explained tliiit it wonlil 
be no rofleotion upon the teacher’s ability if too miiiiy cases won* 
reported. Each teacher responded ontliusiaslicully, Fioin I lie Imt 
of names s ubmitted by tho tcaohera the names of tliOhii sl.udenls 

^ This term was adopted by Unllaid SiuiMtiahtv ami Hpcculi, Jourunl of 
Experimental Pedafjogy, Vol I, 1011-1012, pp 208-310, and will bn UHed in Huh 
ropQit to designaU a leCt-hanUcd mOvvidual who has loarninl in wiiln wiUi ihn 
light hand 
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who had incUulcd m Iho unseleoled group were checked The 
pupils whose namoH remninrd wcic carefully tested. By the use of 
this pioceduro sixteen casea^ were secured m which the combined 
scoic on llio five uninumual handedness tests was negative four or 
lower and in winch tlio light hand was used for writing. These 
sixteen cases coiiHtitnle the second group of dextrosmiatrals used m 
the pi (‘sent invesligation 

In addition to tho immiauunl and biirumual handedness tests 
each dexliosiniHtral was given three speech testa: 

1. AHicaldiion 7'ck(.—T ins tcBt consisted of a senes of sentences 
which were read aloud by the subject while the experimenter checked 
on a lecoul hIh'oI piovided for the purpose those sounds that were 
made incoricctly. 

2. Spontaneous Speech Test —The subject was shown a picture 
and was askod to do.scribe aloud what lie saw. The experimenter made 
detailed iiot('.s of any ajicech dofoots 

3 Oial Heading Test —Gray’s “Oral Reading Check Tests” were 
used. A lecord was kept of llic tune required to icad the whole 
selection lallicr than eacli piiiagraph. Tins modification was made 
in oulor that the (‘xpeiiinontcr might direct his undivided attention 
to the ciioiH made, Hiiioe an accurate record of the oirors rather than 
of the rate of loading was dcsiiod. 

In addition to tlu* data galliercd by means of the handedness and 
spoocli tests, the paionts weie inUu viewed to obtain their judgments 
concerning the hundednesa of the subjects and to obtain the facta 
relative to the Insloiy of the subjects' Bpeoch and writing habits. 

'I’hc data for the two groups of dextrosinisUals, twenty-three 
cases in all, aic incsontod m Tabic I The first seven cases aic the 
doxlrosmistialH of the unholcclod group of five bundled eighteen 
pupils 'fho ciisea in each gioup are arranged according to the grade 
reached in Hchool at the timo this investigation was made. Since the 
investigation wji.s made .shoitly after the second semester had begun, 
the ago of the subject afc the beginning of the second half of the 
school year was used foi the data in the column headed “Age ” The 
unimanual to.st .seou’s arc given in toiina of unit scores, (Por a defini¬ 
tion of unit Hcoi'CH st‘(‘ the first papei of this scries) 


‘The laojKiilion of dt‘\lMnimslialH in the uiwlopU'd gioup ja 0135 ± 003 
Kiiu’o Bixlccn (’iiHi'H fdUinl in tin* n*tiiniiiiiiK Sioiip of piijiila, tlio piopoitioii is 
0152 .t 003, 'i'lu' liclwci-ii lli« Uo piopmtions is 0017, wliieli is less 

Uuiii Uk' piolinhlc rum of 011111*1 piojioitum 



TabIiB I —Dexthosoistbai<s Studied in This Investkiation 


122 


The Journal of Eihicnlional Vt^uchohupj 




seo*c oa sweeping, raking, and snav 




Hiudtes in Handedness 


12S 


A study of the ages of the subjects and the grades reached in school 
shows that one of the subjects—Subject 784—was seriously retarded 
111 her school woik. I'his subject had an IQ of sixty-twoi and was 
adlictcd Willi a mild epdepUe tendency. According to her third 
grade tcachor, these faet.s nceounlcd for her extreme retardation 
A Btiuly of tlu* combined unit scores on the imimaiiual tests shows 
llmt nil the cilsch Kcorccl negative four or lower and are, therefore, 
ilofinitrly left-handed. Thi.s diagnosis was corroboiated m every 
case by ilie parent’s judgment 

A study of tlie speech test maulls shows that m two cases, Subject 
407 and Bubjeot 030, speech defects wore present at the time of the 
invostigalion. Subject 407 failed to arliciilato accuiately the ‘‘b,” 
"p,” and ‘Mz” sounds. IIis difficulty was diagnosed as faulty articu¬ 
lation. This subject showed no tendency to stutter Subject 636 
liad a mild li.sp Slie Hubslituled the "tli” sound for the '*s" sound 
No additional speech disturbances were detected by the spontaneous 
.speech test oi )iy the oial leading lest. 

Tlio roBults of the speech tests wero confiimed by the interviews 
with tlic parents. According to the paionts’ rcpoits only Subjects 
107 and 036 had bpeccli defects at the time of the investigation. 
Subject 104, at idiout two years of age, when aha first began to 
talk, stuttered noticeably This speech disturbance continued in 
mild form until she reached the third giadc The disturbance then 
disappeared No speech defects were present at the time this investi¬ 
gation was in!ul(‘. The fiist gindc teacher attempted to teach the 
Hubjcct to use lier iiglit hand for wilting and was successful without 
much ditUculty. '^L'ho mothci stated that this was due to the child's 
temperament The child was easily managed and the teacher, there- 
foic, liad little difTiciilty in stalling the child to practice the use of 
the right Iiand in writing Since the fiist grade, tlie use of the right 
hand for ivjiting had been consistent. The parents reported that this 
training did not mciease the seventy of the stuttering. 

Subject 10 developed n very marked case of stuttering when he 
was about two ycaiB of age Thib disturbance lasted foi about a 
ycai, aftci which it guidually disappeared He had developed no 
speech (hstiu'l)iiiice.s bineo that time. Dining the pic-school period 
Iho subject used the left hand foi writing. Under the influence of 


•Tim wiiLer ]h nidelited lo the school authoiitica foi this mfounfitiou -The 
UincU-Smioii test wna used 
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the first grade teacher, who licatcd llir cliild'ji difTieiillu'S hynii)iithoti- 
cnlly, the subject leaincd to wiUe with Uu* nglit luind Nit effect 
upon the speech function of the IrttiiiiUK lu the use of tlu' right huud 
for writing was observed by the pnroiUS 

Subject 676 stutLeied slightly when she first livii-ned to tulk. 
This disturbance bad diaappoarcd by the Uww the, child was tluee 
years of age. No speech disturbimcrs had develojied since (liat Imie 
The subject used lici left hand for writing until she eiilered tlie second 
grade Her second grade Lenchcr pemunded her to ])nudici' writing 
with the right hand The teacher encouraged lh(‘ ehild and eMucised 
considerable patience in helping her overcome the dinicullies Since 
the second grade, the subject has used the nglit hand for wriling. 

When Subject 703 was about three yoar.s of age the, mother 
attempted to train iier to poiform the principal unimamial aclivities 
right-handed The child began to stutter I'ln' niollier becalm* 
alarmed and, on the advice of a neighbor, discoutiuued the training 
The stuttciing disappeared about iv year and i\ lialf later and dnl not 
appear again, When the child entered the fust grade the ji.uentH 
insisted that the tcachoi train the child lo ivnln %Yi1b tiu' light liand. 
The teacher and the paicnts treated the cliikhs difiicullies syiniiatheti- 
cally. No effect upon the speech funclion of Uu' liaitiing in writing 
with the right liand was observed. 

The foregoing data may be sunununzed thus' Two of Hit' twenty- 
thiee dextrosmistrals evidenced speech dcfccls at the tnni* they weie 
tested, In theso two cases the speech disturbanci'H aiipeaied wlieii 
the child first learned to talk. Pour of the, tweuly-lluee hubjects 
were reported to have had a speech disturbance at home time previous 
to tho investigation. In these ensea no connoctum between llm tiain- 
mg in using the right hand for writing and the Hjieech disluibimct' 
could bo established. The remaining seventeen dexlrosiniHlrals had 
developed no speech defects at any time. 

Before an interpretation is made of the above data two additional 
facts relative to the history of the subjects’ writing biibits rmiat be 
noted In all twenty-three cases the inleiifiivc training in lh(‘ uho 
of the right hand was started after the speech habits bail laaioine well 
organized, that is, after the subject liod entered the timl grade. In 
two cases punishment was used by the teacher Lo Uam Llie olnld to 
write with the right hand. The second grade Loaclier repriniandod 
Subject 619 severely and pumshed her by slapping the himdH, abaking, 
etc. Tho child had considerable difficulty in teuruiiig to write with 
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the riglit Imncl. Ilor oiuly attpmpls produced writing m mirror form 
The Ircalnioiil .she received by her second grade teacher made her 
nervous and iiiilable but did not, accoiding to the parent’s report, 
affect her speecli. Suliject 692 was punished by slapping the hands 
and by shaking. Ilm fiist grade loiichor frequently sliappcd the left 
hand to the ijody to picvent the subject fiom using it during the 
wiiting period. This lioatmonfc made the child nervous but did 
not produce ii speecii disturbance. 

The data pK'.scnted in tins paper are not subject to any serious 
limilation.s. In all twenty-three cases there is no doubt concerning 
iho liaiidednoHH of Llio subjects or concerning the speech disturbances. 
The data form un impictsive army o£ fo^ts the mteipietation of which 
will be briefly consideied 

Those data tend to show that in training a left-handed mdmclual 
to wiito with the light hand, the handedness of the subject is not a 
suflicieiit condition to produce a speech disturbance. It appeals 
to bo the oxcoptuui lather Hum the rule for a speech disturbance to 
be pioduGod by training left-liandcd individuals to write with the 
light hand Any explanation for those eases m which a speech dis- 
turbanco follows (lie sluft from the left hand to the light hand must 
thcrcfoiti 1)0 based u]ion a factor or group of factors which opeiates 
only in oxeeiilional cases. An explanation which is based solely 
upon the noiirologieul basis of ieft-handedness is therefore inadequate 
The nevvouK bynteiri ih far moio flexible Ilian \?4 implied in such theories 
The vtiiioiis motor and speech aieas in the cortex are not localized 
to such an extinit that it i.s inipo.ssiblc for a left-handed individual to 
leain to write with the light band without di&Uubmg the speech coor¬ 
dinations Most left-handed individuals who learn to write with the 
right hand do not develop speech disturbances 

It in, of couiKO, jiossiblc that in training a left-handed child to wiite 
with the right hand, factor.s other than the conflict between the right 
and left hand may be brought into play to produce a speech disturb¬ 
ance For (‘xuiniilc, if the subject is emotionally unstable and is given 
no Hiiocial caic, or if the teacher employs a method of training that 
produces a soriouH mental confusion on the part of the subject, the 
probability of irroducing ii speech disturbance m much greater than if 
an attcnipl is nuulo to treat the chikl’B lUIliculties inielhgently 

The data prosonted in tins study show, however, that under ordi¬ 
nary conditions tlio danger of producing a speech disturbance, after 
the speech habits have been fonned, by training a left-handed child to 
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write with the light hnnd is very slight. Tlie neivous system is 
sufEoiently flexible to allow ai\ mdivulual Uivviiig a Blioiig lefl-hnmled 
tendency to bo trained to develop the complex eoordiimlums loquircd 
for writing with tho right hand wilhoiil bringing about a ilintiirbanco 
in a closely related seiics of lino coordinations such as are involved in 
speech, 



THE CONDITIONING OF OVERT EMOTIONAL 
RESPONSES 

HAROLD ELLTS JONES 
Umveisity of Cnlifoirnia 

Tho lahoiaLory iceord which has been chosen for this report 
doiivcs iniorcHt fioin tho fnefc that it duplicates, in a human subject, 
and in a biiikIo oxpoiimtmt, many of tho typical phenomena which 
have been described in the literature on conditioned reflexes in the 
lowoi animals 

The experiment was conducted in an isolated chamber, on a plat¬ 
form inlaid with thin biass strips, the strips were one-quarter inch 
in width, separated by (juailer inch spaces, and connected alternately 
to the positive and negative piimnrics of n Porter inductoiium, Foi 
greater quiet, n fifty dv. tuning foik wos substituted for the reed 
makc-bicak of the indiictorium Care was taken to adjust the second¬ 
ary coil of tho mductorium so as to givo an clcotrotaotual impulse 
restricted to a range of low intensities; the stimulus value may be 
desciibed ns a mildly uncomfoi table “tickle” lather than as a “shock ” 
Tho subject for this oxponmont was Robert B , a child fifteen months 
of ago, of a markoclly stolid and npathctio disposition, able to walk, 
and possessing ii spcalcing vocabulary limited to fewer than five words 
When lie wns biouglit to tho laboratoiy a group of toys on tho plat¬ 
form atti acted his attention IIo eat down m the middle of the plat- 
foim and umiiiinod oonlcntcdly at play wlien left alone in tins 
bituniion. TTvo olisorvcis, concealed behind a one-way vision screen 
three feet away, i ecoi ded the clnkVs overt behavioi m as great detail as 
was posHililo by a winipk* olisrrvational method. The mductorium, 
liatterioH, and ii sybtoiu of bolls ami buzzers, were housed m an appa- 
inius box in a coinei of the room. liobciVs oiigmal lenotion to an 
elcctiic boll, winch was sounded foi approximately two seconds, 
could be doHcrilicd as “mild intriest,” shortly becoming “indifference ” 
After four repetitions ho no longei gave any observable reaction to 
tins (uuhtoiy stiiniilus. Stimulations weie now given, at inteivals 
of about fifteen sc'conds, iissoGuiting tho boll with the elcctrotactual 
bimiuluH Aftoi two .seconds with the bell, the mductorium circuit was 
establislicd, and aiulitoiy tinil tiicUial Htiinuli were continued together 
for tliieo hecoiuls. 'Flic application of the tactual sLiinulus (felt eithei 
on hand oi foot, oi Ixith) lesuUeil in a prompt shifting of the skin 
areas which were in contact with tho conducting strips, in each case a 
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slight but mimistakflblc stfiitlc icaclion was u'giHtorod, iiccoinjjaiuod 
by cxpiossional changes such ns ii box-hliiiped mmith, or a puokoi'ing 
or pouting of the lips, anti fion'iontly hy vocal inunmirK or a slight 
whimpering "whioh coased at tho end of (ho sCiiiiiiIatioii penod Jn 
the periods between stimulations, llobort played (iiiiedy willi tho 
toys, and showed no overt uuhcalioiiH of a poismting appii'licaHiviaiOHs 
01 emotional upset. After throe assoeiaiKHiK wi(U (ho \u'muviy 
Bfchnulus, the boll was souiKled alone; foi (he eimuiug live Htiimilal.ions, 
startle reactions were lecoidcd which wcie indwtinguishuiilo from 
those elicited by the primary sliimiUiH; the socnjul olihcrvor, who 
of course lieaul the bell, but laid no direct means of knowing when 
the eleofciotaotual stimulus was used, judged (hat (lie associations 
with the unconditioned atimuliia were being conlimied tlirougli eight 
(instead of thiough merely the fii.st (hrec) successivo Inals 'i’wo 
stimulations by a buzzer were also effective m giving slarlle leacUouH, 
although with appreciably greater delay A Miuill hand boll, of very 
different timbio and frequency from tho conditioned sIuuuUvh, elicited 
no reaction. In the following iiials an cxlmctivc inhibition was 
established to tho bell, and six loinforconioida were given; in live of 
those, the olcctioiactual stimulus was leccivcd on llio foot and not 
on the hand, and it was noted that the stimulus to Uio foot .showeil a 
reduced effectiveness. At the flflicth trial, after oighlemi pM'snida- 
tiona of the conditioned stimulus alone, a (Ml was still jijOHent: Tho 
subject moved bis foot sharply, turned liis Iiond away, and vocalized 
in a manner interpreted as “scolding " 

After twenty-four hours, tho child was again bumglit to the laboni- 
tory He entered the chamber readily, seated luniself on the jilaU 
foi’in, and began playing with blocks At tho first piOHonlatnm of 
the bell he paused and listened, at the Bccond he Btarlod slightly and 
murmured; at the third he began to whimper, and sliowcd overt 
movements similai to those which had been elicited at tho lioginning 
of the expeiiment by the piiniary stimulus For the bii/.zor, fliBtiub- 
ance was less marked, and for the hand bell only attention icspoiiHcs 
were recorded A small piece of zwieback provided Hobert with an 
activity which foi the time being inhibited overt roapoiiHCvS to the bell. 
In the later stages of extinctive inlubitiou of tho ovoit ivspoiiho, it 
was noted that "implicit” responBcs occaaioiuvUy Rlill oecurK'd, un 
iLLuatrgted by pupillary dilation or by flushing.^ 

'A fuller mstnimontal study of conditioned rraettons lm« hroa repniti'd iii 
Jones, H. E,: The Hetention of Ckmdilioned Emotioiml Ilonctions in Infanoy 
Journal 0 / Genehc Psychology, Vol. XXXVII, 1030, pp dSC-^iOS 
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Altov aovoiUy-two houia, the fiifll upphcaiion of ihc bell resulted 
in monipniiivy ovymR, ou the second lie cued and withdrew his hand 
slowly; 011 the Ihivd ho showed a gcneializcd bodily startle reaction. 
These wore the most uiiukod icaponses wlueli were obtained during 
the entiio hcucs, and the experiment was discontiiuicd in order to 
avoid fuilhoi oiiiolioniil (hBluihance. It should bo noted that the 
conditioning was diHtmelly to the bell and not to the platform, in the 
iniorvalfi botweon siimulaiions he played about freely in contact with 
the hm Hlnps, and shciwed no lipsilaliou in touching them There 
was no condil loiuiig agauist the total situation (of eiiteriug and playing 
ui tliG room), and no indicaLiou that the expeument pioduced any 
harraful caiiy-ovor iii tho child’s normal play aoLivitics 

Opporlunitics wcic lacking to test the lalei course of the C-E, in 
view of the miltlnosH of tho piimnry Blimuh employed m the original 
conditioning, it nuiy be expected that the C-E would be short-lived, 
tho effect of tolcphono and otiici hells would be to inhibit rather than 
to maintain tho icaciioii, In conducting an experiment of this natuie, 
it is obviously dosirable to select a child of a stable make-up and to 
proceed with cau'ful atlentiou lo the possibility of psychological 
damage. At the ago imdpr considoialion, and with properly super¬ 
vised ooiulitionH, it iH fair to say that the cxpeiiment involves \m 
iisk of emolioniil iipRot, oi of any injiswtmg ill effects, than an equiva¬ 
lent amount of lime Hpent m a routine physical cxamumtiom 

For purposcH of classroom pvcsontatioii, the writer has found it 
useful to summiuize the fmcgouig data in the form of the following 
table: 
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Stimulation 

SUinulua 

Overt 

IVocoi*} 

number 


rosponno 


Cuircnt 


Hlnrlli' u'luituiii to uncondi- 
liniifil HliimiluH 

1-4 

Bell 

-1- ' 

IjlWdllgalOiy K'lKlllflliB 

6-10 

Bell 


Ncftnlivo mlnpLnlioii 

11-13 

I Bell, cuufiit 

++ ! 


U-18 

Bell 

+ -1- ! 

Hlatllc rotu'limi Ui 
lioiK'il stiiiiuhm 

19-20 

Bui;!ior 

h 

Ci(Mii'rnli/.ittum of tin* (Ml (u- 
mdmltoii of excitrdum) 

21 

Hand hell 


Spociiilimlioii of tlio (Ml 
(discriuiuiiilKiiij 

22-24 

Bell 

-1- 


25-2G 

Bell 

— 

Kxliiiclivc iiiliihilion 

27-32 

Bell, cuircntr 

d- 

Ueiiifon'iiimiiL 

33-60 

Bell 

d- 

Iti'-Hidili'-liod C-It 

AfLor twenty-four hours 




61-64 

Bell 


)Siiiniiiii([()ii (?) 

65 

Buzzor 

d- 1 

60 

Hand bell 



67-60 

Bell, food 

- 

Tenipniiiry I'vloriuil iiihdnlioii 

01-62 

Boll 

d- 

03-66 

Boll 

— 

Ejclmelno inhilnlioii 

After seventy-two hours' 




06-70 

Bell 

++ 

Hpoiiltinrotia lecovoiy (dis- 
iiiltibitiou) 



CERTAIN AMBIGUOUS TERMS IN EDUCATIONAL 

PSYCHOLOGY 

STI^rillSN MAXWELL COREY 
Do Painv UmvoiBity, Grconcaatle, Indiana 

It IS dinicuU in uiidoiBtand why educational psychologists should 
bo so httlo concoriiod with tho lerminologieal status of thoir field. 
Many woi ds, if wo may judge by tho frequency with which they appear, 
are intended to bo cxtiomoly meaningful, but what they mean is vague 
Yet textbook writeia state dogmatically that a “habit” la this, or 
"loarniiig’' is that, without appnient realization of or mtorest m the 
fact that tho.se torms moan one thing to them, and something else to 
tho majority of Ihoir icadois Nor docs it seem wise to smile at this 
disagiccnienl, and contend that it is after all just a matter of words. 
Aliy science must depend upon Umguage for its development, and the 
value of a HCienco i.s hugely a function of the precision and accuracy 
of the wokIh tliat symhohzo il-s meanings When words are used 
looholy, “tho inirid approaches a condition whcic practioally every¬ 
thing 18 a thing-iini-hob or what-do-you-call-it ” From a ceitam 
point of view, educational psychology scorns to be in some such, state 
Too many of tlio technically iifiod woicls aie indefinite They are 
nwkwai d tools for thinking and treacherous aa well foi their ambiguity 
leads to confuHioii, and an inability to distinguish between separate 
factors 

In an attempt to make this ciiticisin more concrete, some of the 
meanings attached to the words habit, learning, intelligence and 
instinct arc presented. These are four of the oldest, seemmgly most 
leveled, and certainly most widely used teims in educational psy¬ 
chology Volumes have been wiitLen concerning each, yet none 
conveys a precise moaning Each is understood, after a fashion, and 
fioely iiiterproLod All wiitcrs use the same symbols, but the ideas 
for which the .symbols .stand aio practically indetenmnable. 

To illustrate, coimider the term “learning” Piobably no single, 
Ro-called tochmeal word, la luoic widely used by men m the field of 
education. Tlioi'e luo hMuning curves, learning peiiods, the learning 
process, psycliologics of leaining, and so on almost indefinitely To 
asRiimc, howovur, that writeison these subjects have in mind a common 
idea would oloiirly demonstrate a lack of acquaintanceship with the 
facts The word ‘Tearmug” is a standardized symbol repieseuting 
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an unstandardiKcd concepf,. It i8 dcfiiipd by edueulKiiiid psycliologiats 
in one oi' moic oJ tlie five following ways; 

1 Learning as giowth 

2. Learning ns RyncjnyrooiiH with incmoriaing, 

3. Leainmg n^icpK-soniuigniiVinorcorlc-^^ponnuiKMit eliange in lirliavior not 
du® to matuiation 

4. Learning as Rynoiiymous with piliirntioii, or ujiDKiiiplimn n gonl 

6. Leainiiig as coiiucptioii-foiinniK. 

Kale Gordon is one who advocalos Uw‘ tMUwoiiUeu of letu-mug us 
giowlhd She wiites of Uie gvowlU of motor capacilit'H and iuHtiuctH. 
Learned beliavior is Lohavioi that has "gunvo" lo lie more elalioiato 
and subtle Giowth is always m lUo divccUou of gieuLcr complexity, 
so that all change is not growth, and honco not learning Lonrning 
takes place only m the tranRition fiom wiupht to cumpk'x. Judd, 
Koffka, Bnlilor speak of llir “growth" of the mind, llie ''giowth" 
of certain capamlica and abiMties. They me dmciples of the develoii- 
mental typo of educational psychology Kvia-yLlnng m growlh, a 
rounding out, “closuic." 

To another group learning nioioly moans inomori'/ing Sea‘-lioro 
devotes an entire chapter to what ho calls Iho leniinng piooo^s, but ho 
disouflscs only memory.® PJllabiiry n.H.siiines a siniihir point of view 
when ho stales that "learningis no more lliun Ihc fornmlion of uhsooui- 
tions."3 This conception of learning was quite conunon among all 
early psychologists, and was clearly expounded ami developed liy 
Ebbinghaus Ilecently> however, some writern Iiave atfiuniileil lo 
distinguish between mcmonsiuig and Icajning, imiinlamiug ibat the 
former is pre'Cininently a function of the ecrebuim, wliile hauinng Ih 
palajencephalic- 

Some psychologists, in an atloinpt to rendnr an all-meluKive defini¬ 
tion of learning, state that it is compiiscd of all more or less jiei'mamml 
modifications of behavior, save tlioso which come wholly from maUna- 
tion.^ Accoiding to this definition, learning takes place when one 
loses the ability, once possessed, to recite a iiarlicular poem. Oolvin 
writes, "The learmng piocess may chiefly bo de.sorilaHl m i(b most 

^ Gorilon, Kate “Educational Psychology'* P 32f, 

’Seashoic, 0. E,: “Intioduction toI'Hycliology.” Chiip. 13 

’ Pillebury, W. IJ.5 “EiuidamoiitftlaQC PByclioloKV,'* V Uilf) 

* Cameron, E 11 • “Educational Pflychology" P, Kin I,(‘aiiiitig iti ili 
broadest sense compriso<i nil modifications of behavior oxcept liioHo wliiih losiilt 
fiom puioly physiological changas, and Uioho which coino wholly fioiu iiu'U'ascd 
maturity 
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geneiftl terms ns the modifications of ihc reactions of an oigamsm 
tlirough cxpciicnce ITc docs not lulc out physiological or maturity 
changes, piovided they be effected or mfiuGnccd by experionco. 

To other writers, leaining lias always had philosophical implica¬ 
tions (llapai'ode, in a section of his book where learning and educa¬ 
tion aie iise<I inleichangeably, writes, "It [?] is not merely a matter of 
exeicihiiig the iiUelligenco, of furnishing the memory, but rather of 
diiecting llu‘ cluuiioLer iipiight, of sLimulaUng zeal, and of developing 
the will and peisonality Tins concept of learning as a change of 
boluivjoi ill a cortain dn fiction, towaid a goal, is rather common 
Lcnining is cnllod “pioRt from experience,"® it requires evaluation, 
and therefoie cannot be studied solely with the methods at the dis¬ 
posal of psychologists. How can psychology decide whether a certain 
change in behavior repiesents piofil or loss? 

Again, learning is not only considciccl ns a modification of behavioi, 
Init also ns a inoiIificaUon of neural conditions. In the face of our 
relative ignorance of its nature, many writers in education and psy- 
cliology (Infino learning in terms of the changes in the neivous system 
winch accompany it TKorndiko’Bbtateincntthat '^Icarnmgis connec¬ 
tion forming”' caiiiod weight. Starch rcpiodiices the thought in 
■those woi'iIh; “PiobaUly all foims of Icaimng can be loclucod to one 
relatively scliematie typo, lleception of impressions through the 
BciiRPs; assimilation, untvlyais, and combination of processes in the mind; 
and rediinotion of impulses to produce a reaction; or m brief, stimulus, 
nssociatiou, and lo.sponsG."' Galea wiitcs similarly, “learning con¬ 
sists m th(‘ stiengllioning and weakening of connections between 
situation and response.”® 

Tlio natural le.sull of this lack of agreement as to the nature of 
le.aining is apparent The intere.stcd and intelligent layman thinks 
that educatora don’t know what they oi'e talking about, and if they 
cannot agree among tliom&clvcs as to what learning is, how can they 
loach Ins child? IIis reasoning is not easily criticized, and the lack 
of agicemont is all the moie confusing because it is not merely one of 
woids, but involves ideas ns well 

* Clolvm, K H ''Tin'LeiumnK Piaocss ” P. I 

® ClaiiiLuVli*, 1*1(1 ‘'Expciimmliil PcdiiBogy.” P 

®GvilhUi, Colrmmi U “fSt'ueial Intioiluction to Ptiychologv ” P 119 In 
otlun wokH, Lme profit fiom oxpeiioiicp (leiiiiiiiig) iiuist icpicscnt a tuuctional 
cliango in Uio norvous HVHtPiu 

^tStniciv, Ilauiol “KdwcftUoml PBS'cUology" (Revised Edition) P 127 

® Gale?, A. I , “Payohology for Stiidenls of Education ” P. 238. ^ 
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Tho concept of 'Mmbit" is in much llio hiinic prctlicinnciit. Tlioro 
are almost as many different ideas as to Iho naliiri* of habit na Ihoio 
are outstanding educatois. Some aUacli a diffcrimt meaning to the 
word each time it is used. Obviously, like lenrmui;, linliit fornialion 
may bo and is considered fiom two basically diffcieiit points of view, 
neurological or bchnvionslic. Many aulhors imikf* Ibm diHlinolion 
clearly, bub in their subsequent use of the term, no liint is given as to 
which side of the coin is being cmiBidered Warrim dofinrs habit, as 
both, a “process of forming coniiectionK in the nervous aio’’* and as 
“an individually ncqiiiiod and stereotyped seru's of u'sponses oi 
thoughts.”^ Is each of these a habit? la a liubib only pieseiil when 
both conditions aie fulfilled? Do tho two occur concoinilanlly, or 
does it make any difference? 

More pertinent to tho subject, oven among thoi>e (uitlioiH who 
attain and consistently hold one point view, ncuiologieal or boliavior- 
istio, there is a lack of uiiamnuty as to ^Yhat ii halnt is. Si>ini‘, for 
example Judd who bpeaks of “Lenining or habit forniaUon/''’ (MinHider 
the term as equivalent to Icniiiing. Whutovoi is loiunod m Ibciofoio 
habitual On the othei hand, habit is thought of as bonu'tlung which 
18 largely automatic, mechanical, stcrcotypcil, i<'Hs di'pcndi'nl upon 
consciousness. Pillabuiy dcBnca habit us a tomlfnicy, “llu‘ tendency 
of all movements and of mental opcnitionn which involve little or no 
movement to become meciianizrd.”‘ Or, in the wouIh of Jiiiiu‘9, 
“An acquired habit is nothing inoic than a new iialhway of diHchargc 
formed in the brain, by which cerium incoming oinieuls cw) ujln 
tend to escape.'’® The main concern of this ginup is Uio deb'rmimil-ion 
of a basis upon which to distinguish habits from inslinclM, 

Nor have tho pos.sibihtics for a misiiUoiin'otaUon of the word 
“habit" been exhausted. Many wiitcia cannot use the teun without 
involving ethical considerations. lie is habitually neat, or lionest, oi 
cowardly, or courteous, ho has “good" or “bad" habits. Accoiding 
to the many followers of Thorndike a habit is a specific, automatic 
response to a definite situation, but tho extent to wliioli ivo aio said 
to have the habit of honesty is a function of the numboi of widely 
different situations to which wo respond m ft {jeneiaUi/ lioncsL iimniuu 

^"WaneD, Howard C.. “Elcimsuteof Ilumnn l^sycholcuy.'’ 25y 
P.403. 

* Judd, C. n “Psychology of Sccondaiy likhicnUoii ” P. 54 

^ Pillsbury, W. B.* “Education 08 the Paycholograt Hcch Tl." 1 * U (1 

«James, WiUiam “Psychology," Briefer Ckiursc. V 13 l. 
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There are racial habits, specific habits, general habits, mental habits, 
and moial habits; in terms of the nervous system or in terras of 
behavior To ono a habit may be anything learned, to another only 
those reactions which arc stereotyped. Probably an author is not 
certain just what lie moans himself; he may rest assured that his own 
meaning 10 seldom the ono conveyed to the reader. 

The concept of ”insUnct” is so confusing that many authorities 
advocate abandonment of the term m anything approaching a scientific 
discussion. Tins amliigmty is not ao much a matter of the existence 
of instincts as it is a conflict ovoi the best way to explain them and 
which reactions .should bo labclod instinctive. Instincts, too, may be 
considoi’ctl flora either a ncurolo&oal or behavioristic point of view. 
All wiiLcrs stress Ihoir inherited natuie, but theie is little agieement 
a.s to their puipoHivonoss.^ Some attempt to differentiate clearly 
lietwccn rcllexofi and insUncta,^ while others slate that any distinction 
is basetl upon relative complexity and is made for convenience only ® 
Instincts are classified m terras of neuiol organization, behavior, the 
.situation.^ fltimulaiing Ihom, the puiposes which they seive, 01 the 
emotions accompanying them. Some wiiters list many,* others only 
a few ^ 'i’hore is no concensus of opinion aa to whether a certain 
leaction fihoiild still be called instinctive after it has been modified 
by expciioiicci, or whelUei it should be termed learned.® In one 
context an instinct is a specific reaction composed of a number of 
reflexes;'^ in nnollier it is a quite variable pattern characteiized by its 
puiposivcness and progiuss toward a preconceived or unconceived 
goal ^ Some wiitors tiunk of intelligence and instinct as being 
aiilitliotical A typical quolaUon, though seldom appearing in so 
naive a form, is: “The behavior of animalb ib regulated by instinct, 
that of man by luteUigoncc, by icason ” Opposing this view, Myers 
writes. “I conclude then, that instmcts aio not, as has been generally 

^ Yet McDougall wutos *‘OiitHnPS of Psychology” P 71 But tlio gieat 
jnajoiity of all piutios would ngiec that we may piopeily call mstmctive those 
I'pactions of amnmls wliicli t>oem to be puiposivc 

* ICoffkii, Kuit. "TIk! Giowth of the Mind ” P. 90IT 

^ Cnmcion, E II ■ Op. cit , p *12 

^Tiioimlikc, Fj. Ij,. “IWucationni Poyoliology " Yol I 

“ MoDougall, IVdltivm' “Outliiicnof Paychologv” Chap. V, 

“Mojgau, C Tdoyd’ “Animal Behavior” P 71 

’Watson, John n “Ilohnvioi ” P 106. An nistincb is a senes of chained 
icflcxos. 

*KofIko, Kurt Op. ctb, Chap. 3i 
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supposed, idenLifiablc with reflexes; nor are liiey, as otlioia liave 
urged, a ierlmm quid beside reflexes and mlpUiRenee. AccoidmR to 
my view and my ii&o of the word, inatmcl, regiuded from withm 
becomes mtcUigcnce, intelligence legaided fioui without becomes 
instinct To Mycis the diffeiouce between insUnci and inlolligence 
seems to depend upon the position of the observer. 

Wo aie inslmcUvely kind, clcvei, stubborn, oi ciitical. All limt 
we are is the sum of our instincts and I'xpericiices, an (•(Incalitmal 
platitude ficquently stated but as nieimingless us the statement iliat 
the word "it” is nothing moic that “i” plus "t " The word ‘'instinct” 
13 used loosely and ropioscnlfl no definite idea. It may mean any oiuj 
of a half dozen things, yet its use continues m our acieiitilie (liseu‘'Hioi)s 

Lastly, the woid "inlclhgence,” though iciwlily and freely used 
in technical wiitiiigs may lepiosent any one of the following concepts. 

1. Ability to adapt onoeclf to novel situations * 

2. Cajiacity for knowledge plus knowledge ])os3t'-.Hed ° 

3. Inhibition, nunlysia, peiserverauco * 

I, Capacity to acquire cnpncitics * 

6 Capacity to Icnm or piofit by cxponcnco « 

0. Judgment 

7. The functioning of two factors, one general and opcialiiig in nil HitiuiUoiM, 
the Qtlici specific awl opcintingni encli paitunflaT fiUwation,'* 

8, Abstinct thinking.® 


' Myeia, C. S.‘ Bnlish Journal of Psychology, Vol IIT, lillO, p 218. 

^Pintnci, R , Journal of Bducaltonal Psychology, Vol, XII, 11)21, p lUi) I 
have always thought of iiitelligonco ns the nbilily of Ihe iikIivkIihiI Ui ndiijil limi- 
aolf adequately to iclativoly new tnluatious m life. 

’ITenraoii,V. A C, Op cU,p 20lf, Intelhgettcciiwclvcstwoeiipiu- 
ity for knowlcdgo plus kiiowlcdga possessed, 

< Thurston, L. L Op cik, p, 20ir Intolligonce . . eoaluuis at least tlinn* 
pisychologically diffetenimblc components* (1) Capacity to ledeliiu* an nmliiK.livc 
adjustment (2) Capacity to inhibit an inalmclivo adjustiiK'iib (Jl) Tlio 
volitional copaoity to icnlizo the tnodilicd mstmctivo boliavioi into ovci t lieliavioi 

® Woodrow, Iloibert Op. cu, p. 208 

»Dearborn, W. F Op cU., p 2U. 

^ Binot and Simon Peyc/iofoffiflMC, Vol XI, 1U05, p UlC Time ih in 

mtolligonce, lb seomfl to ua, one fundamental organ . , . Him is jiulgnient. 

sSpeaiman, 0.. "ThoNatmoof Inlolligoiicc and the Pniieiph'H of C'ogmlion ” 
P 4ff. 

«Tcrman, L. M.: JouttmI of Educaiumal Psychohigy, Vol. XU, l‘)2I, p 728 
An individualiB intelligent in proportion aa ho is nblo to cairy ouuIhIuicL llnnking 
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This list could bo greatly extended. Some definitions would 
include moial and pei'sonality trails as a part of intelligence; some 
would include the emotions; some would consider the word as being 
doacripLivc of lieliavioi, some as being a static component of the 
“mind 

The lack of coneevn ovci tins btalo of affairs is siiikmgly illustrated 
by Dearborn, who begins bis shaic of a symposium upon the nature of 
intelligence thus, “The commonly accepted definition of intelligence 
is . . ”2 'pho very series of aiticles to which he was contributing 
brought into iclioC tlie fact Uitwt tbcrc is no “commonly accepted” 
definiliou of intelligence, nor is there much of an idea as to its nature 
Picssoy comes out with the slaitling confession that, although he 
spends most of hi.s time mcRsiinng intelhgence, he la not much interested 
m its naUiie. 

This hick of agiceuient over the nature of intelligence is more than 
one of dcrnution. Brielly considered there are two extreme points 
of view hold l)y Thorndike and Spearman respectively, with other 
authoiiUes occupying the gi'ound m between. Thorndike believes 
that wo have us many mtclhgonces as wo face situations, while Spear- 
mnn believes Ihtii his G opciatcs in all reactions Quoting Thorndike • 
“A table of the known dogiccs. of iclationships would abundantly 
confirm the Htatoment that the mind must be regarded, not as a func¬ 
tional unit, noi even as a collection of n few general faculties which 
work nrCRpcctivo of pmticular mtvtoiial, but rathei as a multitude of 
function.s, ouch of which involves content as well as foim, and so is 
related closely to only a few of its follows, to tlio others with greatei 
and greater dcgrccH of icmolcncsss 

Iniorprotmg a similar table of iclationships Spearman writes: 
“And thus tlicio emerges the concept of a hypothetical general and 
purely qualitative factor underlying all cognitive peifoimances of 
any kind . . . The fiictoi was taken, pending further information, to 
consist m something of the nature of an energy or powei which serves 


* Yob wo uin ucioss bins foilowiiiR miotaliou Momoe, WftUor S “Dueotmg 
Lcaiiiiiig in tho High Sciiool " 1* 302 Somo words tlint aie used with only a 
general iiicaning m convorsaLion nn<l in iion-fccelinical fields, havo been assigned 
piocmomoaningsiii tlin field of oilupfttion Examples of auoli words are Staiulaids, 
mtolligciKio, . . (‘to, 

^Dmhoin, W l'\ JonimloJ EducalionalPsycMoQy, oji ctf.p. 211 
® Thorndike, F. L,. Educaltonnl Psychologyt Vol. Ill, p 3Q0 
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in common the entire cortex (or possibly even t)ic wliolo neivous 
system).^ 

All of tho available space between 'I'liounliko aiul Spearman is 
occupied by authorities ICveryoiio can find ii tlefiniiioii of intelligence 
to suit his tompernment and capacities. Ah Sponnriun iiuH so well put 
U. “The reasoaIS now Gvideiit why all hoaicli for the, lueaumg of lutcllU 
gence has, even with tho gicfltcHt of niodi'rn pHyeliologists, always 
ended in failure. It is simply tluit, in point of fact, this word in Us 
ordinaiy present day usage, does not possc.ss any definite meaning. 

The fault with ccluciitional writers i.s tliat too many attempt to 
give a pedigiecd meaning to a mongrel woid Tong ago tho clicmist 
learned that if he wished to convey a icsiicctable thought ho must 
use a respectable vehicle of cxpiession. IIo no longer speaks of table 
salt, but rather of sodium chloride. It is as iniposbihlo to ovtract 
piecise, scientific meanings fioin woidb on the tongim of every novelist 
as ifc is to inject such meanings into words winch ahoady ayiuliohiio 
any number of diHeiont concepts. 

If popular terms can’t bo isolated fiom popular nirunlngs new ones 
must bo manufactured, and Icclureis and novclihls will not make the 
change. 

' Spoarnan, C.' Opi etf., p 5. 

2 Ibid.. V 10. 



THE AUTOiNIATIC PREDICTION OF SCHOLASTIC 
SUCCESS BY USING THE MULTIPLE REGRESSION 
TECHNIQUE WITH ELECTRIC TABULATING 
AND ACCOUNTING MACHINES 

DAVID SEGEL 

Dppni tinpiit of llescftrch, Long Bcacli City Sclioola 

The prodiction of scholastic success in general, and in the secondary 
school and collrgc field in particular, is in need of devices foi shoi tening 
the laboi and tune necessary for calculating individual prediction 
scores. This is true mainly because the prediction of scholastic 
success usually involves the use of the multiple regression equation. 
The work requned to calculate scores after a multiple regression 
equation in obtained is almost prohibitive m a practical situation. 
It i.s possible, ns Hull has shown,* to construct special machinery 
which will inake picdictions according to regression equations that 
have boon worked out. However, the cost of constructing such 
inacluneiy foi this siiecmlized use probably will prohibit its extended 
uso foi souk; tiiiie. In the inciinUmc it seems desirable to adapt the 
use of automatic calculating machinery more generally available 
to the problem 

We found that tlic tabulator and key punch units manufactured by 
the International liusinoKS Machine Corpoialion undei the Hollerith 
Patents wisre machines which would perform the opeiations indicated 
by the iiiulUplo legiession equations when such equations were 
adapted in certain ways 

Wc will de.scribo the ubc of these machines by desciibing their 
use in a particular instance. 

We wished to make success picdictions m the junior college field 
in Oflch of llio following subject gioups Physical science and mathe¬ 
matics, English, social studies, languages, and biological science, 
on the basis of the numbci of A’s and B’s eai-iied in high school, the 
scoies in the Thui&tone Psychological Examination, Edition of 1929, 
and the scoies on the vniious paits of the Iowa Content Examination, 
all I'Gcoidfid at the beginning of the junioi college course. 

The conclalion of any one of these items with oollege success is 
usually loo low to bo used with much efficiency in prediction (cxcep- 
iiona to this general staleincnt arc shown by our own data for physics 

'Hull, C L.: "Aptitiulcj Testing,” p 487 
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and mathematics), and thci'pforo a coiiibinalion of hcoies or ratings 
into a compoaiie rating is deaiiablp. Willi a viiiioLy of correlations 
of the sepaiate items with success in a college subject present, it is 
desirable to weight the items diflfcicnUy from iho natiual weighting. 
T:he method whieli gives this best weighting is llic nuilliiile legre.ssion 
equation technique. 

For the purpose of this desciiption we .shall linni. oui,selves to 
the prediction of the first two of our college subject gioups. 'PIic 
GYitmion of Bucecss U\ tho fiubie<it gvovipB iH tluv vuiuk. uuulv uv the 
subject groups the first semester in junioi college The ooi relations 
between the items nnd the two college Hul)je(5t groups me given in 
Table I The inLercoirelations between the tests me givoiun Table II 


Tahle I—ConnEnmoNS uetween Prudiotion Itkmk and CuiToniA 


Criterion 


MaUicmftticfl fliul physical 
Bcionce 
English. 
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Upon the basis of these coriclntion.s the ^'s for the juuUiple regics- 
siou equations were obtained. 

In order to use the Hollcnlh card which ih un'd in tliese jimclum'H 
it was necessary to reduce all scores to a busiH of 0 to 9 iiielii.^ivc, 
coTiespondmg to the mimbcra on Iho llollonlli omd. T'bis was done 
by reducing all distribution of scores to a basis of 0 to 0 according 
tg the schedule of Table III. 
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Sigma 

TiaiiHinuted score 

Sigma 

Tiansmuted scoio 

— CO to —2 0 

0 

0 to C 

5 

-2 0 to -1 fi 

1 

Sto 1 0 

0 

-1 6 to -1 0 

2 

1 Oto 1 5 

7 

-1 Oto - T) 

3 

1 Sto2 0 

8 

“ 6 to 0 

4 

2 0 to 

9 


The muHiplo logi ebsion equation •which is in general^ 


Xo — - -^01 23 
O’! 


• + **^02 131 . nXi 

(Ti 


+ -^i3onl234 . 

Ojt On 


<70- 


where 

C — Mq — /3oi 23 


n “ fioi 13 . ti'-Xa — /3on 123 

oi a% 


O^Ov 


will bo Pimplilicd because all sigmas arc equal since all distiibuUons 
have been reduced to a sigma basis. The equation becomes a 

-^0 = /3oi 23 - n-'Tl 4" ^02 131 .. . n-X ^2 4" 0On 123 • (r)-l)Xn 


C disnppeaia because 

ilfo ~ /3 oi. 23 . . tvXi — /3 o2 131 • nXi . . ~ ftn 123 * (n-l).X’n = 0 

The /3’8 resulting will be m the form of a decimal fraction. Wc have 
arbitinrily changed those fractions to whole numbers ranging from 0 
to 3 inclusive in order to fit out tabulating equipment The equation 
for physical science and maihomatics is ns follows. 

^0 = OXi -f- 3 X 2 4~ 3 X 3 4" X 4 4" Xb + OXfl 
where the symbols have the following meaning in tianamuled scoie 

Xi = Number of A’s 4- B’s made m high school 
X 2 = Tliurstone test score 

Xg = English test score of Iowa Iligh School Content Examination 
Xi = Mathematics test score of the lo'wa High School Content 
Examination 

Xe = Science tost score of the Iowa High School Content Examina¬ 
tion 

Xo = Social studios test score of the Iowa High School Content 
lOxamination 


UCelloy, T L “Statistical Metliocl,” p 283, forimila 213 
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The equation is roducccl to 

Xo = 3X2 + 3 Xa Xi + Xt, 

since 0A’’i and OX 0 drop out. 

Because of changing fractions to whole mnnborH and restricting the 
weighting to 0 to 3 incluaivc, the multiplo cnnolation cooniciont is 
reduced somewlinb. The multiple coirolaiion enenieu'iit of the above 
equation for mathematics and science i« .80 Before the reduction 
and restriction above mentioned, it was 81 
The equation foi the prediction of English was 

Xo = 3X, -h 2 X 2 + X,. 

The multiple coirclation coefficient for this equation is .02 Before 
the reduction and reatiiclion was made, il was 05. 

The method of using these equations with the taliuiator and 
key punch is as follows: 

A Hollerith caid is punched for cacli student The raid used 
IS one divided into secUona of thico colnmiiH each. In eacli .section 
the transmuted score of the testis punched ineveiy column. A f^ainpln 
of the card is given here for a student who made a hooio of four in 
high school marks, a score of five m the Thurntone test, a Hcoro of Hi\ 
in the English pnit of the Iowa test, a score of five in the inatlieinatics 
part of the Iowa test, a score of four in the scienci' part of tlie loiva test 
and a score of seven in the social studies part of the Iowa test 

Cards so punched mo put into thclabulnlor and the wiring adjusLed 
to fit the equation For physical science and inatlioinatics tlie wiios 
will be connected as follows* Three to Iho Tliur.sloiic score scotion 
( 3 X 2 ), three to the English part of the Iowa lest (HX.O, and one each 
to the mathematics paifc of the Iowa test (X^ 4 ) and the science pait 
of the Iowa test (Xs). With this wiring the caid.5 can bo am tluough 
the tabulator and the weighted scoics for each student will be added 
up and the sum printed together with the minibei of the student 
In case the tabulator is not a printer or one winch adds up the diffeKUit 
fields, the numbers can be added up mentally and the lesult together 
with the student's number wiiltcn down. The composite sciiio 
so obtained may be used diicctly or transmuted into Liu* hoiiolarsliip 
scale used in the institution. Where the muUiplo coneliition eoidli- 
cient 18 not very high the regressive oITect of the equation should lx* 
accounted for in any transmutation, that is, the original spriMul of tlio 
scores must be restricted to fit the effect of the regression equation 
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In caso tlio multiple conclation cocflicicnt ih liigli the legresHivo 
effect being small can be dwegarded In this way the cjucIb can ho 
run through the tabulator again and ngmii until a piodicLion ia oliliunod 
for each subject. 

The method described should Ijg of value not only wheio largo 
numbers of predictions aie desirable foi use in mdlvuhud guidance but 
also for purposes of homogeneous clnssificalion upon the basis of seveial 
different items. With the data punchod on the curds at cnnvonicnt 
times duiing the semester, the cards can be run through mid a new 
homogeneous classification determined for vniimis subjects wilhiii a 
comparatively short length of time. 



A TECHNIQUE ECU EXPERIMENTATION ON 
GUESSING IN OBJECTIVE TESTS 


LOUIS GRANICII 
Ciollfgp of Uic Cily of Now Yoi k 

At a time wiicn the pedagogical status of iho true-false test still 
“hangs m the balance/** there would seem to be a considerable field 
for a technique pocuhaily adapted to oxponmentation on the element 
of guessing The wutor'a "index of guessing" is obtained by scatter¬ 
ing, among the gennmo questions of a true-false or multiple choice 
examination, a number of questions which involve very obscure facts, 
or newly coined names. As applied here, to a group of college juniois 
and seniors, it gave considoinble evidence of its validity; it was success¬ 
fully employed to icdiiee guessing, proving more effective than the 
usual instructions against guessing; and it was suggestive of a new 
analysis of responses to true-false questions, 

PllOCEDURE 

A fifty item Iruc-fivlso test on gencial psychology, containing at 
iricgular inteivals ten index questions, was administered to a lecture 
class 111 social psychology. Attached to each sheet was a pre-test of 
twenty items of the recall, or complotiou type, based as nearly as pos¬ 
sible on tlie same topics as the true-false test, 

Tlio instiuctions pieccdmg the true-false lest differed for half of 
the papers. Tiio control group (Gioiip A) received tho following 
full instructions against guessing: 


lliiAD TnnsB Instructions 

Put a circle aioimd Right oi Wiong You are not expected to lecognize all 
of these statements Do not Quess, because of the usual scoring system 

The remaining half of the class (Gionp B) found these new dnec- 
lions on tlicir .sheets; 


' lluch, G M • “The Objoclivoor Now-type ISxamination " Hcott, Poiob-mnn 
and Company, 10‘20, p 365 tk*® pp 318-368 for au oxcoUout digest of cxpcii- 
montation on tho suhjeefc discussed hoio, Note that piohably tlio best piacLico 
in tnie-fftlso testing mvoivca instiTictione ngnmsfc guehsing, nml scoiing which 
corrects for guessing ciiois 

lifi 
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Head ThbsB Instiwctions 

Put a ouolc around Right ot WioiiR- You aio uot cM’wlod to iccogniao aU 
of these statGiueiRs Do mi guess, boenusp of tlio ununl bcoiiur ayfllpni. 

Siippohc you met this question UWTliel^ink Ohmts hu'uhuio tho (liHciimitia- 
tion of cinotiona. Tlicro aio no I'\mk Chnil*!, nml if tluuc ^vpro you could not 
have hoaul of them To answer Una quoalion would nulicnto guo^suig on youi 
part Tlioio mo a good luunbor of qurstions of Ihn typo mu\ of Hundar type') 
ecalteiPcl thioiiRh tlus tost I5ach one will iiidicalf if aiiHwmcd 

Thcipfovo auswei only what you know. 

To obtain a random halving, Iho sola woio aiiangOfl nltoinatoly 
accoi’clmg to the two types of diicetiona and woio doiilt out thus 
Each student received a comploto lost act as he ontcied All tlirections 
supposed nccGssaiy were punted on the sheets, and no rjue.stiniiH wine 
permitted across the room, for obvious reasons. 

The gioups were, then, random halves of a liighly nolected group, 
each half numbering tliuty-four They weio o\ppclefl to cliffei on the 
true-false test because of tho new instructions. Tho pro-tost was 
eonsiclored advisable, in order to confirm the aumlavily of the two 
groups as to distribution and total amount of infoimalion. 

The method used here for cstabliBlnng a control was preferred as 
one which resembled the pioccdure of an ordniiivy clas.srooin lest, anil 
did not smack of experimentation to the iLudcnlH. Evmy effort was 
made to give the test under clasHiooin conditions. Several other 
consideiations portaining to Inter iiilcrprctations also caused the test 
to be giv^n m the form described. 

The scoios of the two gioups on the pre-test ranged fioni six to 
twenty. With a maximum possible score of twenty, the inoiins weie 
12 56 with a PE of 2.1 for B and 12 23 with a Pl'^ of 1.9 for A The 
groups appear similar enough to render significant any considciable 
differences which might be found on the true-fulse tests. It should l>o 
noted that for most of the mean amounts given below the deviations 
weie large, and where differences ocemred, oveiluppiiig between both 
groups was consideiable. 

Time was not called iinlil it appealed that piaclically eveiy 
student had finished. The students wore then aslced to indiciitii the 
questions on which they had guessed. Pieoiiulions weie taken to 
seciuo complete cooperation. The studoulH were luUUessed lufoi- 
raally by the wiiter, who is not thoir instructor,* uiid were told tliat tin- 

II am indebted to Dr Maximilian 11 Schnoek of tlvn CoIIoro of ilio City of 
Now Yoik tor permission to admimstCT thw cxaimnation 



Guessiv^ %n Objective Tests 


147 


test in no way concerned themsolvos, that its purpose was purely 
expciimental. They weic asked to tear off or delete their names, or 
any other ulcntificationB, from their papers. The point was repeated 
to them that in spite of their directions they certainly had guessed on 
some quosUoiia, piohably on n large number. They weie asked to 
cooperate in an '‘mtorcstmg experiment” and to indicate by a capital 
G nil guessed answers. Papers woi*e then collected. 

The writer latoi had the opportunity to receive objections from the 
clngs against the pioceduie of the experiment A number of students ' 
questioned the ability of the class to indicate its own guessing No 
opinion was mot that lack of compichcnsion, suspicion, or resentment 
had affected the frankness of the class. 


SuMM/LitY OP Results 

Evidence of the cooperation of the class is found in Table I. It 
will bo been that in Gioup A, seventy-two pei cent of those questions 
called “guessed” wore actually correct, while in Group B, seventy-five 
per cent were correct. It may bo safely assumed that the class tended 
to be unresolved in indicating guessing; which was the effect desired 
And yet both groups indicated ns guessed only half of the index ques¬ 
tions wliicli they answeiotl. The explanation of this apparent paradox 


TadI/B I.—Mi:\n Scoiuis of Gnoup A (Contiiol) and Group B (New 

DinECTioNs)^ 



Group A (34) 

1 Gioup B (34) 

Pre-test flcoTCs 

■ 12 23 (PE 1 9) 

12 60 (2 1) 

Index questions niiswou’d 

4 2 (PE 1,7) 

19 (12) 

Index questions mdionU'd as guessed 

2 1 

1 0 

Actual questiouH iiglit | 

27 2 

25 1 

Actual questions uiong i 

6 3 

6 1 

Actual questions omitted 1 

0 6 

9 8 

Actual quesUouK mtlieated hs g\U’‘-"cil mid correct' 
Actual questions indicated ns guessed and incoi-! 

3 8 

3 3 

icct 

1 6 

1 1 


‘ Notn Lho mv.i' of tlio PE’h of the iiulox diBtiilnitions foi both gioups Tlio 
diiToronco Ijctween the pro-test nipam bears n ratio to its P E of about 76, making 
it of sigiuficiuu'i' Ah foi tho index, means, the ifttio of Uie dilTciciicc to it^ P E 
IS about 0 C, easily deiuoiistiafcing statistical aigQincanco j 
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will appear later It is evident, however, that the student's intioapcc- 
tion makes a poor index of guessing. 

With reference to the decrease in guessing, it will be aocn from 
Table I that omissions were increased forty-nine per cent. Tlio num¬ 
ber wrong was decreased nineteen per cent, the numbm iiglit right 
per cent and tho number indicnlrd iis guoKsed soventern prr cmt. 
Comparison of this last figure with the others shows that Clrniip U 
was readier to admit guessing tlian was Group A. It Hliould be siressed 
that all results heic oblamed aie based on a single test and on a highly 
selected group; so that the icliability of Ihe^ diffciencca is no!, iinally 
established for all groups. To judge by the moan number of index 
questions answeicd, guessing was reduced about ono-haU. Ilowevov, 
it may be argued that smeo Group B was put on guard against those 
questions, the results on the index may not be valid n.s a ineasuio of 
guessing—that the reduction was caused by tho it'CognUion of the 
index questions as such, and did not iiidicato a leductiaii in gue.‘'Hing 
on the body of the test. Tlueo evidences arc offoicd in answer; 

1 Argumentative evidence which will be piesonlcd liolow in the 
analysis of student responses. 

2. Each group marked as guessed almost a precise half of Iho 
index questions answered. As a matter of fact, jl will aiiiieiir from 
Table I that Group B, as compared with Group A, londed to over¬ 
estimate the number of its guessed aosweis. This has been pointed 
out above Group B was therefoic leas aware of guessing on Llioso 
index questions which it answered than was Group A; since if they woi o 
equally aware of guessing, and readier to indicate it afioi tlu* Ic.sl, 
they should have indicated a greater proportion ns guessed than did 
Group A. When Group B, theieforc, guessed on an index (luostion, 
it was at least in part due to tho fact that they wcic relatively unaware 
of guessing. The relative tendency against guessing canied over 
from the body of tho test, and explains wholly or m part the reduction 
in the average index score 

3. Tairly conclusive evidence is furnished by these figuios: I'or 
Groups A and B, the ten higliest and tho ten lowest pie-tcst Hcoro.s 
were selected, and their index scores compared, ns shown m Table 
II. Tho pre-test scores were used as tho ciitcnon of acliicvunuint, 
since the true-false scores were subjocl to vaiying factors and were 
therefore unsatisfactory. It will bo scon that the lioat and the poorest 
students scored about the same on the index. I'oi (Jroupa A and B 
the ten papers weie then selected which had tho highest and lowest 
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number of index questions answcicd, and thoir pie-test scores were 
compared, as shown in Table III It wdl be seen that the students 
who guessed most and least on tho index weie equal m ability. These 
figures indicate roughly that no significant relationship exists between 
knowledge of the material which has been studied and ability to 
discein tho index questions. An additional conclusion winch is bound 
up with tins latter would have to be, that the better students do not 
cliffor from the pool or in then tendency to guess, or rather to attempt 
questions which arc now for them. Such questions of course consbi- 
tute Ices of sheer guessing foi the superior pupils. Furthermore, the 
absolute number of such qucsiions is greater for the pooler pupils. 


TADiiU II — Mcan Kgorbs ok Forty Studeots Sqi-bctbd AcaonniNG to 

AciIinVB^IBNT 



Gioup A 

Gioup B 


lliglicst 

Lowest 

Ilighesb 

Lowest 


^ ten 

ten 

ton 

ten 

Pro-toab 

i Ifi 5 

9 2 

10 

8 3 

G\ic98cd (index) 

1 4 5 

4 5 

1 6 

1 7 

Guessed and indioated us guessed 

2 6 

2 3 

1 1 

0 

Tadle III — Mean Hcouds or Forty 

Stddents Sbeected AcconniNG 

TO Index 

iSoORBS 





j Gioup A 

Group B 


Iligliest 

JiOWOst 

Ilighest 

Lowest 


ten 

ton 

ten 

ten 

Index seoie 

7 5 

1 7 

4 1 

3 

Index questions indicated as guessed 

3 6 

1 2 

2 4 

3 

Pietest 

, 12 4 

1 

12 0 

12 4 

12 4 


Tho validity of the index, then, is appaieiUly not affected by 
awai’oness on tho pait of tho student oi by hia knowledge of the 
subject oovGi’Gd. The index does not howevei puipoifc to be an 
absolute measure of guessing, since it coninins a certain amount of 
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recognizable material* Diffeient index facorca will result from 
difierent sets of index questions. Uut if the items lire equated as to 
their indicati-ve values, they form a basis for piecisc eoiupansonfi, luid 
for correlative work. They are obviously ns applicable to the multiple- 
choice test as to the true-false. 


Thk Indkx (iunsTioNs 

The ten index questions are given here in the order in wlucli they 
appeared on the teat, followed by figures rcprcfeeniing tl\c vosponses 
elicited by them of light oi wrong, and also the number of times they 
•were indicated as guessed. 

It will bo seen that the guessing element in these questions vuiics 
from an almost absurd amount in bevernl, to so small an amount in 
otheis as to reiidoi them almost conventional. A bettor index would 
be composed of equated itema. It ia not sheer gucbslng tJiat la 
measured by most of those hoic, but the tendency to attack material 
that IS new, and offers no legitimate basis for an answer. 


'• Nor doe's it lacaavii e tlioso questions which ftio answorf'd with i\n even chanco 
oi success If it did, the foUo^Ylng formula could ho appheth 


wlicre G is the number of questions guessed, / tho mniibcr of qiicslioiiH computing 
the index, N tho number of Uicso questions answered, and 0 Liui mimbor of omis¬ 
sions on the body of tho test Half of would icpicsenl tho numhoi right oi the 
numbci wiong thiough guessing If tho foimula bo applied to out diilii above, ii 
striking similarity i8 found botwcon both gioups, in thou rstmmtcd "tuio" hcou's 
T he numbei' right or wrong through guessing is 2 <1 foi Group A nud 1 2 for (Innip 
B Subti'Rotmg these ainoimta (lom tho number right to find tho “Uiui" bwu', we 
obtain 24.8 for A and 23.0 foi B. Subtracting fioin tho nuinbei wiong to hml tho 
actual amount wiong for othoi reasons than guassing, wo obtain for botli hulvrs 
an identical remaindoi of 3 9, This is what wo aliould expect for auuli snmlai 
gioups furthermore, the latio of fchoir O's is about equal to Uio ratio of tlirii 
index scores The explanation of theso agrccmcah, lioivevor, presonta many dilli- 
culties They are probably spurious, unless by accident tlio index aftiiiplad ^ 110 ^ 14 - 
ing ooriectly. Tho possibility of using tlio index ns n rofmemont m bcoiuik, oven 
for groups as n whole, lequucs further doinoiwtiation 

It may ho argued that tho indov questions, if equated, conluui a consUint 
proportion of guessing, and con bo converted to puio guosMing scoics by multi¬ 
plication As will appear later, however, what wo encoiiutoc ou tho te.st ih iiu(i 
pure guessing, but gueaaing diapciscd os an element among many questions, niul 
subject to uncei tain rules of probability. 
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The qucsUons aio composed oithei’ of obscure facts or of proposi¬ 
tions involving a newly coined tom, and should be conventional in 
strucLuie The practical application of tlie index and of tho new 
instructions, ipmains to bo further doinonstmted. It may bo that 
tlie piosont standaid instructions {Do not guess wiless you ho^vesoniG 
basis for an answer) will offer tho best lesults, and that guessing need 
not bo fuithcr i educed. It may be that R-W scoring is more valid 
for tho very reason that it takes into account the wrong answers. 
It will provo too diiTicult to construct testa with reliable individual 
indices, and too oiimbcrsomc to score such tests, to allow of their 
widespread use The use of meaningless material may prove objec¬ 
tionable ill classioom practice since it renders possible ictention of 
matter whicli is undcsiiable. It may also bo said that the new instruc¬ 
tions are thicatcning and piiniUvc m attitudo. But they aic no more 
so ossGutitiUy tluLii instructions which warn of R-W scoring; m fact 
they offer moio lensonaiilo justifioalion lo tho student for penalizing. 
Whatever pedagogical faults may appear against the technique, theie 
lomaiii many pohsibditics for its use m objective tests outside of tho 


Taulpj IV —SiiowiNO Tim I3i'’Fi!}C’rivnNFisb or tub VAnious Index Questions 



Marked 

light 

Marlccd 

wiong 

Indicated, 
as guessed 

1 Convergonco of fauloj'H will pjolmldy explain 
tlip tiansfoi of tiaming , 

li 

12 

0 

2 Tho Juko'a Instoiy hIiowh that fouiteoa por 
coat (lid nob bccoino pulilic oliaiges 

32 

10 

1-i 

3 The acqiuaiUvo insLiucb is today conaidorod 
condiictivo iia well ns clynainic 

10 

s 

8 

1 One caiiao of illusions is tlic functioning of dif- 
fvispd nsaocmtioTi-area 

23 

1 

1 

5. Theve ft\o ncvci inoio than tlweo thalamic 
incmbiaiios 

‘1 

4 

7 

5 Glniidulai mi&funolioiung is the cause of pit- 
unosis . 

9 

0 

fl 

7 Dividing a Icaiiiiiig cuivo into /oiiea incien&cs 
ipliability hut lowois validity 

10 

10 

11 

8 Tliero ate mom HCiisilizi’d pigment spots in the 
hiain than in the spinal uoul 

17 

m 

10 

0 Laselles found tlie wliiLo and colored laces 
about C(iual m keenness of pcioeptioii 

17 

m 

18 

10. I'Awg was lha psyehe-awab'ttt to veCuCe Ihe 

Gxistonco of tho negative peisonality 

0 

9 

g 
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classroom. It will be noted limb the pobsibihly of detection consti¬ 
tutes adequate motivation foi reducing guc&sing 

The distribution of index scores (Table V) ffhows (hat extreme 
amounts of guessing arc almost entirely chmiuatcd, while there is a 
much gieater fiequonoy of vciy small ainounl.s 

The writer found those questions easier to inopuro tluin (hose whicli 
were leal. Care must bo taken only that obscure fuels be obscuie 
enough, and that an answer of False should not by sonic chance bo an 
honest and correct answer to a tentoiico involving a nooiogism, us for 
example, m “The acephclon is located in front of the thalamus ” 

The greatest utility of the technique lion in furthoi theoretical 
investigation Among the possibilities arc: (1) Coirelativc work and 
the dotennumtion of lelations between guessing and the diffoicnt 
elements of a test situation. (2) Compaiison of the amount of guessing 
going into different typos of tests, including oven completion tests, 
also, estimation of the relative amount of guessing going into flpccifio 
tests, (3) A study of the distribution of sliidont-typcs ns regard? 
guessing. (4) Analysis of charactonsUcs of questions which nivito 
guessing. (5) Study of tlic extent to wluch students arc iiwaio of 
their guessing (6) Hotentlon of content with different Icsls (7) A 
meaauie of one phase of classroom discipline, and of tJie olTecliveno.sH of 
different inatruotions, moUvations, pcrsoiiahtics, ole (8) Kxpori- 
mentation loading to the perfection of the index, coniirming its viiluUty, 
and dcterinming its possible application to the classiooin Tho pos- 
Bibility of employing It as a reftnement in scoring m of greatest iinpoi^ 
tance here, 

Tho dilemma appealing from oxu results is this: While only luilf of 
those index questions answered are indicated as gacs.sefl, thice-quailei.s 
of those 80 indicated on the test proper are concct It la of couiae 
assumed that the effect of “specific dcteiminers” alone will not explain 
this The analysis which will presently be given i.s suggested in 
explanation of this phenomenon. It docs not, of couiso, derive any 
definite corroboration from our figures, but is incicly suggc.slcd by 
them. 


TADr.nj V —Distiubotion op FiiraiUBNoiiJs or CiuU'^siNtj 


Index score 


I'lequeney, Group A 
Prequenoy, Group B 


1 

2 

1 ^ 

B 

6 

6 

i 

1 

fi 

fl 
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Gues&ifig in Objective Tests 

Tub Nature of Responses 

Discussion to date has assumed that the response to any question 
18 determined by one of sevcial factors; either information, guessing, 
misinfoimation, oi a "luinch” icsulting from the characteristics of the 
question (Wiedemann’s specific deleumners). It has been recognized 
that guessing vanes at different times, with different gioups, under 
different lest conditions, and also with each individual examinee It 
has boon found tliat guessed answers are more often correct than incor¬ 
rect;^ and tins fact has been explained ou the basis of subliminal con- 
figuiatioiis of knowledge. There is also evidence that ll-W scoiing 
ovei-penalizes students;® and it liaRbccn pointed out, in partial explana¬ 
tion of this fact, tliat answers wrong through misinformation are 
penalized doubly It is obvious that this routine analysis will not 
sufRco to explain our results in this study. A closer analysis of the 
faotois dotoimiiung a response la therefore relevant. 

Questions are factual insofar as they measure the recognition of 
terms or of facts. Questions arc deUberaiive, involving judgment, to 
the extent that they icquuo the recall of facts to decide the truth of a 
statement not already taught A question intended as factual may 
sometimes be attacked m dclibciative fashion, to substitute for or to 
supplement lecognition. "Deliberation” involves recall, comparison, 
criticism, ingenuity, application, practice in pioblem attack, and any 
number of phases of gencial intciligcnce It may be an acceptable 
compensation for inability to iccogmze, if by its means the correct 
answer is arrived at, from true picmiscs and by a coirect process of 
reasoning. 

The answci to any question is the result of a number of factors, not 
of one. Thus in the (rather pooi) question, Wundt established ike 
first psychological laboialoiy in 1879, n student may recognize the 
name Wundt (infoimation) but be uncertain as to whether this man 
was the pioncei in question (guess). He has an idea that Titchener 
was the founder (misinfoimation) lie docs not lecognize 1879, but 
decides Us probable accuracy by cheeking it with other dates (delibera¬ 
tion, as well ns guess) The piobablo accuiacy of the date, and other 
considerations, now lead him to behove the entire statement true 
(hunch, or suggestibility). lie answers m spile of his uncertainty 
(mental set as to gues.siiig fioni directions). 

* Wc'it, T. V A Ciitieal Study of the Uiglit Minus Wi'ong Method Jouinal 
of Edncalional TtchCaich, Vol. VIII, 1929, pp 1—9 

^Uuch, G. M Op. cit,, p. 362 
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We should then regard guessing as a/ar/or iiisofai as a (jiicsLion is 
answered with uncertainty, while inisinformtiUoii becomes an inade¬ 
quate term. There may be miKinfoimation, it is tiuo, as to a pait of a 
question; xnoblematic or pnitiy problematic questions anHweiod with 
certainty but mcoiiectly are fniily fiequcnt. JHit pnictically all 
instances of misinformation, ns defined hitlicrlo, arc aocoinpiinicd more 
or less by uncertainty It is difiiciilt to aasuino that studonts learn 
complex facts in a form precisely mcoireot. 

If the final score formula for tho mimbor right can not bo oxpiosscd 
jn terras of whole questions, does it tend to bo tiic sum total of the 
actions of information plus onc-half the total of fi actions of guessing- 
factors, plus approximately one-hnlf of tho fractions of huggestibility 
factors? Oi does the final score depend on the proportions in wliich 
these factors are combined? Does each Rcnlence boar ila own rules 
of piobability? (Note that the iccognition of u single Lorm m a Htatc- 
ment may furnish a due to the concct answer, for example, by eliimiia- 
tion.) Do intelligence, training in problems, and application enter 
also as factors compensating, legitimately or not, for lack of knowledge? 
Is much recognizable material necessary to assure a student that he is 
not guessing? Above all, what rules of proliubility govern questions 
made up of dHTeront recognizable, umccoguizable, and problematic 
proportions?'' Would these lules explain tJio over-ponalization of 
R-W SGoiing? Turthcr study might well lio directed along those 
lines. ^ 

It need not be pointed out that many questions, especially shorter 
ones, aio entirely recognizable or unrecognizable. It is also true that 
there are degrees of learning; that some facts mo on the borderline of 
memory. Tins situation introduces other factors which affect Hcoies. 
application, amount of time, and accident m striking upon ofTective 
associations These last few items will bo recognized as iiniveiaal 
causes of unreliability, together with such elements as copying, ambi¬ 
guity of the questions, attitude of student, conditions of the test, 
obscure wording, etc. In pioblcmatic questions nn analogue to guess¬ 
ing IS found in the process of hitting upon a line of reasoning which 
leads to a correct answer, although the background of information is 
very limited, and the judgment poor. 

^Wood found lolationehips bclwcon tho probloinatio quality of questions and 
their reliability, as well as ono aspect of thoir validity. 

Wood, Bon D. Studies of Achiovoment Tests. Journal of Educalnmal 
Psychology, Vol XVIII, 1026, pp 10 and 13, 
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At any rate*, wo cannot icgard some one factor as the single cansc 
of a given Kvsponsp, nor can wo considoi* such responses at all analogous 
to coin-flipping, An exception may peihaps be made for simple, 
short, factual questions 

Wo may now bo able to explain the peculiarities of true-false tests 
which have alicady been, mentioned We know, for example, that 
enough uncertainty may enter into a icsponse for the student to call it 
guessing And yet such questions may contain enough recognizable 
material to be answered correctly m more than half the cases. We 
may now i eject the dubious concept of misinformation accompanied 
by ccitamty. Wc may albo explain why answers which are changed 
by the student aie coirectly changed most of the We may 

deduce from our theory such veiy plausible propositions as these: A 
multiple choice of four anawois may really offer only two actual alter¬ 
natives, since two olheis may be conspicuously absurd Oi, if one 
of the answers is known to ho incorrect, the chance of guessing cor¬ 
rectly will bo one out of three. If, on the other hand, none of the 
altcinativGs are recognizod, but one of them offers a "catch," then 
the chances of couocLuoas aic less than one out of foui 

It IS obviou.s that if a student docs not recognize a fact, he can not 
lomembci whctlior that fact wus ever discussed in class, and can not 
decide whothor ho is expected to Icnow it Unless the question is 
altogether absuid or unconventional in appeaiance, he can not be 
8 U 10 whether it is an index item, or one which ho should know It is 
for this icason that knowledge of the piesenco of the index does not 
affect its validity This analytical evidence the writer has already 
piomiscd to piosont. The effectiveness of the new diiections is due 
to the same situation To guess on an item unrecognized in part is 
risking an incrense in index score 

SUMMA-RY 

1. The index offois a valid measure, although not necessarily 
absolute, of guessing on objective tests. Guessing is lieie defined 
as the toiiclcnoy to answci questions which are unrecognized either 
wholly or m part, when an answer can not be deduced with certainty 
from such inforinaiion as the student possesses 

‘Mathews, O. 0 Knoncoiis Fiist Impiessions on Objective Testa Also, 
Lowe, M L and Ciawfoid, C C Fiist Impresaion va Second TJiought m Tme- 
ffilso Teats. Jotnnal of JSducatioiial Psychologyf Vol XX, 1029, p 106 and p. 286 
leapectivcly 
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2 Warning as to tho presence of index questions iii tlio test used 
here provod to be more ciTectivc in reducing guessing Limn the usunl 
full instructions and waining of pemlization. 

3, For a number of reasons already explained, students can not 
reliably indicate their own guessed answers. This fact m demon¬ 
strated by comparison of index scoicswith our other numerical results, 

4. In this study, superior students did not differ fioin pooicr 
students m their tendency to guess; that is, in their average index 
scores It follows that they we no bdier able to disoorn index 
items even when aware of their presence The students who guessed 
most and those who guessed least, according to then index scores, 
were nevertheless equal in acliiovemcnt according to a pic-test. 

5 Some of the results of this study were difliculfc of explanation 
m terms of the conventional analysis of student re.sponscs to true- 
false questions. A revised analysis is presented, in terms of which a 
plausible explanation can be found for many of tho poculmriticg of 
true-false testa, besides those appearing in ilim study. 

6. Argumentative Gvidence, based on this unalyBis, is produced 
to show that responses aie more often the rofiult of scvoral paycho- 
logical factors than of one. Simple factual quoation.s lu o an oxcoption 
to this rule. 

7. Furthermoic, such answcifi are not subjeot to simple mathemati¬ 
cal rules of probability in scoring; their piobabiliUcs of correctness 
vary according to the different proportions of guessing, information, 
etc, that enter into the responses. 

8. Further studies employing the index technique aio suggested 
above, and studies leading to the oriUcism ami improvcnioiit of the 
index will be of value. 
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The Science of Psychology, An Inlroductoiy Study, by Raymond 

Holder Wheeler. New Yoik. Thomaa Y Ciowell Go, 1929. 

Pp. XI + 560. 

Ill "The Science of Psychology” Professor Wheeler of the University 
of Kansas makes a pioneering attempt to present general psychology 
m textbook foim from the Gestalt point of view In spite ofj the 
difficulty of the taslc, tlie lesult w neiLhei one-sided nor incoherent 
Nor IS it (perhap.s more surprisingly) unduly abstruse oi difficult. In 
parts the discussion involves coilain inherent difficulties, but the 
style is simple and the piesentntion logical and clear. 

Wheieas most textbook wiitors seem to base then eclecticism upon 
the pimciplo that those OKplanations which are moat widely accepted 
at the time of writing are to be prcferied, Wheeler seems to base his 
upon the pYiwelpUv that these cxplanatiens which appeal to him aimplest 
and most inclusive, aio to be picfericd. It would be more accurate 
to say that in both Wlieolei’s book and in the usual textbook there is a 
mixture of tlic.so two principles, but that in the latter there is more 
evidence of tlie principlo of gcncial acceptance than of the principle of 
"parsimony,” wheieas in Wheeler’s book the reveise is the case. 

All living activity is dehcribed by Whcelei as goal activity, governed 
by tliG "Law of Configuialions” and the "Law of Least Action ” A 
goal he desciibes as 

the tormination or end of a given leaponse, howovoi simple or complex 
Tloprcsonted hv those stimuli or objects in a atiimihis-pattcrii, the teaching of 
which rehoves tonsioii in the oignniBiii. Repieaontcd m the organi&m by a lelativo 
eciuibbiiiim in the noiiiormuiciilfti ayHtpm In bimging behavioi mto relation 
with dyiiaimcal pnnoiiilos, the goal is intoipicled ns n point m an eneigy system 
towaid which a body moves undei hLioss, it is theimint of low stiesa of tlicflystom, 
and tho orgniuHin is loguidcd ns part ol the syatem ni which it moves The 
situation IS akin to a giavitfttioii Bystem with its cenlor constantly moving, along 
with shifts in tlio iiligiunout of potentials elsowlieie m the aystom. 

167 
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Whcelev’s clcscription of tbc "Goal” concopl m moio clofimlo anti 
concrete than McBougalPs description of Uie concept of purpoHp and 
leas restricted in scope than the concept of desues proposed )iy the 
psychoanalysts Although he employs it ns an ovphinatory principle 
quite ns umvcisally as these other psychologists, he docs not give the 
impiession of distorting the facts to prove his point of view. On the 
contraiy, the largo iimoimt of expevunpiital data ■whicli ln' brings 
together m the 556 pages of his book is clnrifiod and unified by con¬ 
sistent examination from his defined viewpoint. 

Wheeler progicssca systematically fiom the sociological aspects of 
psychology to the biological aspects, with the chief emphasis, where U 
belongs, midway between these two extremes, on "Kmotive Behavior " 
and "Learning Behavior,” the treatment of the latter being so parlic- 
ulaily thorough and stimulating an to make the book an excellent 
leferenCG or text in advanced couiscs in educational psycliology. 

His tioatment, in the fiist clmplcisof tlin book, of "Social Behavior 
and Its Conditions” is without distinction—just another comjnlation, 
not unusually coherent, of the facts and llicorios gcnouiUy lepoi tod in 
social psychologies. It has the merit of being Lhoioughly modern and 
of containing some valuable and original formulatioiiH of iirinciplos. 
The latter give the impiession, however, of being merely niKCvicd foi 
good meaauio without affocting tho choice of otlioi inalerial m this 
section of the book 

But this deficiency in the first part of the book is in sharp contrast 
with the rest of tho b.ook, and since tho fiiat part is fairly typical of tliat 
vast number of texts whoso chief reason foi existence is tlioir clarity 
and modelnity, it forms a handy lofcrcncc point by wlucli to judge tho 
superiority of the body of the work. John N Wasiibuunu. 

Syracuse University 


Manual for Determining the Equivalence of Menial Ages Obtained fr om 
Uroup InUlligence Tests, by Ross O, Runnels. Test Method 
Helps, No, II. Yonkers-on-Hudson, N Y.: World Book Co,, 
1930. pp 14, paper. 

Expressing Educational Measures at* Peiceniilc UanKs, by V (I and 
0 K Biiros. TestMoihodllelps.No.III. YoiikprK-on-Uu<lnon, 
N. Y.. World Book Co, 1930. Pp. 27, paper. 

It has long been noted by users of tests that thoio lue giohS dif¬ 
ferences in mental ages and intelligence quotients oliluinod from 
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diiferent group LcsU Due to variations in methods of standardization 
nnd differences between the groups by which tiie Vtarious tests were 
standardized, i\ sad lack of equivalence exists between the tables of 
norms. Di‘. Runnels nclminiatprcd the National, Haggerty, Otis- 
ndvanced, Tcrmaii Group and Otis iSelf-admmistedng Tests to 1422 
pupils m Ctvndos V to IX inoUisivo The oqiuvalonco of scoies was 
determined by equaling percentile lanks For each perccnlilo rank, 
the average of the mental ages given by Iho manuals for the vniious 
tests was taken as the new mental age norm. Of comae, no such 
procedure will increase the reliability of a group test, but Runnels' 
tables will bo of great assistance in obtaining more comparable results 
when a vaiiety of gioup tests is used in a school in successive years. 

“Test Method Helps, No II” gives an adimiably clear and simple 
explanation of ranks and percentile ranks nnd includes tables to aid 
the computation of peicontilca when the niimbor of cases is fiom 11 
to 100. For those who arc not adept in the use of a slide rule, this 
little book provides a quicker and casici method of computing per¬ 
centile lanks than lias hitherto been available 

Laubance F. Shapfer 

Carnegie Institute of Technology, Pittsbuigh 


Child Adjusbnenl, by Annie Dolman Inslcecp. New York, D, 
Appleton and Co , 1930 Pp XVI + 247 

A study of tho facts and principles presented in “Child Adjust¬ 
ment” will enable the teacher and educational specialist to gam new 
insight into tho educational process ns lolated to the growth process in 
the school child The book serves to bring together the major findings 
of many scattered bits of research As the author states in the preface, 
tho essential purpose of the book is that of “finding out how the child’s 
body, mind, and emotions differ fiom an adult's, how they develop 
into tho adult stage, and how they sliould be cared for during school 
years.” The topics discussed moludo adjustment with reference to 
height and weight, gi owlli and functions of the larger muscles, handed¬ 
ness and fooicdne.ss, the inteinal organs, diffcient developmental 
ages, iho teeth, adjuslmont in relation to growth of brain and nerves, 
the eyes and ears, adjustment m relation to growth, development of 
the mind, mcnsuieinent of intelligence, cntical adjustment periods, 
emotional lioaUh and mental hygiene la the appendix theio is a 
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discussion of difierent psychological theories, behayionsm, gestalt 
psychology, Ih’eud, Jung, Adler, psychoanalysis. 

The author shows originality in the methods devised for studying 
different factors m child behavior and makes the mateiial of practical 
usefulness thiough hei descriptions of actual school practice in studying 
the physiological, mental and emotional development of pupils. The 
best sources of scientific data have been consulted and are leferred to 
in each chapter The mtenelation of physical and menial factors in 
the child's development is emphasized with each topic discussed. The 
belief IS expiessecl that if the child's home and school adjustments 
have been made with his physical, menial and emotional needs in view, 
the child makes better piogress m his school work Cases of discipline, 
failure, nervous bieak-down, maybe attiibntcd to failuie to understand 
the child as different fiom the adult. 

In occasional instances the leader may feel that the aiithoi lays 
too much stress on physical deficiencies as major causes of maladjust¬ 
ment, as for example when lying and stealing arc found in conjunction 
with adenoids or pooi eyesight, and the behavior defects are attiibuted 
to the physical ones. A tendency to aUiibute school failure to physical 
defects is implied m the author's discusaon, but theie is also emphasis 
throughout the book on the impoitauce of investigating all causal 
factors in an adjustment problem Gbutrudi!] Hildheth. 

The Lincoln School of Teachers College 
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TIIOllNIHKE’S C.A.V.D. IS FULL OF G 

KARL J JIOLZINGER 
University of Chicago 

The chief point of this note is to show that Piofessor Thorndike’s 
well-known C.A.V D. Intoihgence Test may be thought of aa saturated 
with Professor Spearman's g rather than with a number of group 
factors. Professor Thorndike's interpretation of three Spearman 
laws of cognition will also be touched upon This second point is 
doubtless n veiy dangerous one because tho writer is not a psychologist 
and has only a moderate p, while Professoi Thorndike is not only a 
pure psychologist, but must have a g that approaches the colossal. 

The data for tho first point arc furnished m Professor Thorndike’s 
Measurement of Intelligence.^ Here the C.A.V.D. test is compared 
with other mtclUgcnco examinations designated aa follows • 


CAVD , , . Xi 

OtiB Sclf-adminiatoring Test Xa 

Torman Group Tost (Grades VII-XII). ■ Xa 

Stanford BmoL (MA) . Xt 


Tho intercorrolations of these foui tests are given by Professor 
Thorndike and may be written in the form 



Xi 

Xa 

X3 

1 Xi 

Xj 1 


87 

.04 

' 78 

x^ 



' 88 

77 

X, 

1 




.77 


The tctiad difieroncoB* work out 


haa, = -.054 ± .017,h24j = -.017 ± .010,^1342 = +.037 ± .022 

^Thorndike, E, L . "Tho Measuroment of Intolhgonco " Bureau of Publi¬ 
cations, Teachers CJollcgo, Columbia Univcraifcy, New Yoik City. P OOff 
^ Professor Spoarinan's "Abilities of Man ” The Macmillan Company 
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These tetrads may be regai'ded as statistically insignificant showing 
the existence of a common factor g and four uncorrelaied specific 
factors «v as mdicated by the equations (1) 

Xi ~ rHig + n\S\ 

Xi in%g-p /j. 

Xi = mg + W3S3 ^ ^ 

X4 = Wlff + ^484 

The quantities and Ux (i *= 1, 2, 3, 4) being constants. 

The existence of g being mdicated it la now possible to obtain its 
correlation with each of the foui tests (see Siiearman Appendix). 
These correlations arc as follows: 

rip = 960, Tiff == .921, rap = .960, Vig = ,817 

If the piobable error of these coefficients Is of the order .01 or .02 it 
thus appears that C.A.V D. and the Tcrman test aie most highly 
saturated with g while Stanford-Bmet is the least oitcotive measure 
of this factor 

In his own analysis of the above coirelations Professoi Thoindilce 
points out (p 90, op. cti.) that “Intellect C.A V.D. is very much the 
same as that which is measuied by representative examinations for 
so-called intelligence “ Professor Spearman’s method of correlation 
with g not only shows that these four tests aie measiuing tho same 
“intellect” but shows how well each measures this “intellect” and 
indicates that tho “intellect” m common may bo regarded as g as 
given in factor pattein (1). This seems to us a great advance over 
the usual ciudc methods of validation by conelations. Tho criterion 
by the Spearman method is a well defined g instead of a subjectively 
labeled test score. 

It 18 , of eoursG, possible to interpret the same set of correlations in 
an infinite numbei of ways and to employ an infinite number of factor 
patterns other than (1) A certain western psychologist piefeis to 
think of the variables as made up of an infinite number of independent 
elements even when the tetrads vanish- This is a possible interpreta¬ 
tion, but since it esannot be verified statistically and could be made 
regardless of the relation between correlation coefficients, it seems to 
us to have little scientific value. 

When the totrad differences do not vanish, group factors are pre¬ 
sented and more elaborate factor patterns may be employed. Illus¬ 
trations of this sort are given by Piofessor Kelley^ and by Piofessor 

^Kelley, T. L: “CroBBioade in the Mwvd of Man" Stanford Umvorsity 
Press. 
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Spearman {loc. ciL). Borne of tl\o (UiFiculties ansmg from tbo use of 
suoh elaborate pattoins arc tlio complexity oi total lack of adequate 
piobablc eirors to lest the theoiy, and the greiit chniculty in attaching 
meaning to the iiumcrouH faotor.s employed. 

By way of ilkisUating the.^e pointH, wo may Liiko un example from 
Profe5.sor ICelloyts book (p. 07ff.). The foui test.s iiHcd arc: 

so llcftilinn speed 

Xi » AntlimctK! power. 

Xt * Momoiy for words. 

Xi = Memory for inciiniiiKful syiiiliola 

The inteicoiTClalion and tetrad dilTcroncca are ns taken from a paper 
by the wntcr '■ 



1 

A’i 

! -Yj 

1 

1 

AT , 

AT 

A'. . 


0530 


2000 

Xi . . 




2430 

Xi., . . 1 



■Hi 

0008 


ti«84 - - 010 ± 037 
liu) » - 005 ± 037 
lun » .005 ± .010 


From tho insignificiuioo of thoao tetrads wo may conoludo that 
factor pattorn (1) with only j 7 ooininon i8 sufRoicntly complex. If 
group factors are prcsoiit in thiiso four tests thou offoot is insignificant, 
yet Professor ICelley employs the ))attoin given by tho following 
portion of his Table XII {op oil ). NumberB m the table are standard 
deviations 
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‘Ilalziugor, K, J, Ou Tfttuul DdXciGiuics Ovcilappmg Variables Journal 
of Educaltonal Psychology, Fob,, 1020 




















164 


The Jouinal of Educational Psychology 


The abovo example i 8 buL a fragment of Professoi Kelley’s work 
on these data and is not included by way of ciiticism, but merely 
because the numeral work was at hand. As far as these four tests are 
concerned we hold that pattern (1) is adequate Professor Kelley 
employs the elaborate patlom m the above table and interprets the 
common factor a as “heterogeneity, maturity, sex, and race ” We 
argue that the factors a, jS, 7 , 6 , e, f, etc. aic insignificant m these four 
tests, and that whatevei common factoi is found may be regarded 
'as (7 

At a meeting of distinguished psychologists last year several 
expressed giave doubt as to the meaning of g, they pieferied /3, 7 , 
5, e and f probably because specific labels had been attached to them. 
The writei is certainly in doubt as to the correct mterpictation of g, 
but this doubt rises to complete confusion when a half dozen other 
factors are added even though they are shown to be significant. We 
can at least get the correlation between g and other variables when the 
tetrads vanish and thus approach its meaning. The bases for deter¬ 
mining the number, numerical value, and meaning of other general 
factors 7 , 5, e, etc are much more subjective. Such factors may 
need to be added in the aiial 3 rsifl of valuables, but only when pattern 
(1) doesn’t hold as shown by the tetiads. If they are added their 
meaning should be approached with even greater care than the 
meaning of g. 

The whole point of their digression is that when wo do get the 
tetrads to vanish and thus establish the adequacy of pattern ( 1 ) wo 
should be very happy about it We have arrived at n simple and a 
very beautiful statistical explanation. We may also, by the Spear¬ 
man technique, build up a pool of testa concentrated so highly with 
g that we will come to know its meaning more clearly than that of 
tests subjectively labelled. 

It thus appears that Professor Thorndike should be pleased with 
OUT findings. If he ever makes another test more replete with g ho 
should be still happier. He should not try to think of the common 
factor as “heterogeneity, maturity, sex and race/’ but rather have 
these all eliminated and show that g is still there. 

Turning next to the interpretation of Spearman’s laws of cognition 
we may teat these as follows: (1) Any lived experience tends to evoke 
immediately a knowing of its character and experience; ( 2 ) the mental 
presentation of any two cbaracleis (simple or complex) tends to evoke 
immediately a knowing of the relations between them. This law may 
be termed Educhon of Relations, (3) the presenting of any character 
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togctlier with any rolation tcucia to evoko immediately a knowing 
of the correlative cliaracfcer. This law may be called Eduction of 
Comhles. Tho word "uumediatG” liorc mdiGatea the abtence of 
intervening procoRHcs. 

Aocording to PvofoBbor Spearman, mtelliRonce includoB all processes 
derived fiom those lliieo principles comprising tho ability to appre¬ 
hend experience, cduee roluiions niul educe correlates. 

The second of the above laws may be illustiatcd by an analogies 
test. 

Bal. Ball. Ilammo: Boy: Nail Handle: Axe Iloro tho characters 
or fundaments aio the seven ilems presented The subject may 
edu.ee vaiious relationH between these fundaments such as: 

Jiat IS naed for hilUna halL 
Bat }m sajM ijutinl letter «« hnll 
Hammer has Imiullc 

Hammer /los eaiuc laitiat IcUci «« handle 
Hammer ia used for hlltug nail 

In addition to these the subjnet may educe coi tarn relations between 
the lelations listed alcove. Those might include: 

ta used for hilling in niilikn 

xa «se(i/o»' hilling m same aH ij? mat for hlltng 

has same xnxUul Idler us m flainn as has aaine imtial kllei us 

The correct answer to tho original tost is “nail” arrived nt by 
educing some or all of the above ivlalions. Tho question then remains 
■what to do with tho answer ‘^handle” sclncted on tho basis of the same 
initial letter as "liainmor," It may 1)0 nigued that both answers are 
coriecfc or that "nail” la n belter answer than "handle” and should 
receive all or at least mnio credit than the latter. If tho second argu¬ 
ment is followed, then tho subject might educe a relation of the soit. 

"Use of nil object is genaally mote than tho initial 

letter of the object ” 

In any case the above example appcaib to involve only the educ¬ 
tion of simple rolaliouH like the finst live and more complex lolations 
like the last which are dopondeut upon the fust. 

Piofessor Thorndike^ has commented upon these thicc laws as 
follows: 

Thoio JB no (loul)b that t!i« aiiuii'iMutinii and innaaKCiiu'iit of rolalions is a very 
important fcatiii o of intrllrct, by any icasuiiulilo deluiitioii tiioi'oof Yet it bcouib 
hazardous and undcairalilo to UHHiitno that (lio pPicoptiou and uhc of rulations is all 
of intellect In pinoticc, tests in pniuginpli lonihng, m information, niid in range 

*ioc «{, Pj), 10-20 
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of vocabulary, 8eein to signify intellect almost as well ae opposites and mixed 
rolfttions testa In theory, analjrsia (choosing Builable elemonta or aspects or 
Tclfttions), and organizing (managing many associative ticnds bo that each is 
given duo weight in view of the purpose of one’s thought), seem to bo ns dcsorving 
of consideration as the perception nnd use of lelfttiona Moreover, T fear tliat in 
nil four cases wo need other valuations to decide W'luch arc heller lolatioiis, or 
more ahsUacl lolationa, oi more csscniiai elements, or the wore aagacious relations^ 
or the wore consistent oi gamaatvon, of the more dcsi-Tflhtfi balance of weights, and tho 
like (Italics are Thorndike’s ) 

To tliG uPpsychologicftl rtiin-d of the writcv the “other vakiations” 
oited above are largely, if not cntiicly, eductions of relations between 
lelations Thus the concct solution of the Bat; Ball pioblem probably 
rests chiefly upon eduction of the sort. 

uso of an object xs more tm‘pottanllhant}xo mitial letter of tho object. 

This seems to us just as much an eduotion as the case, 

Bat ts used for hxlUnq hall 

In fact nearly all of the “evaluation” cited by Professor Thoindike 
appeals to us as Spearman “eduction.” 

As a further illustration one may take Professor Thorndike’s Task 
1 on p, 163 (op ciL) The subject is to make a true and sensible 
statement, filling one woid m each of the blank spaces: “The . . . 
way to . is by airplane.” The filling of these spaces appears to 
involve eduction of relations between fundaments of a sort. Thus 
the second space might be fi.lled with such words as “ travel, dio, swim,” 
oto Likewise the whole new phrase “way to travel is by airplane,” 
or “way to swim is by airplane" may bo treated as a new fundament 
and the first place filled by eduction resulting m words like “best, 
fastest, cheapest," etc. Furtheimoi’c the completed soiies may 
be related to the fundament “previously experienced sensible fact,” 
and several such completed series lelated by the eduction “more 
sensible " Thus the subject may aiiive at the sentences; 

1 The quickest way to die is by airplane 

2 The cheapest way to travel is by airplane. 

3. Tlie quickest way to fciavel is by airplane, 

4. The Blowcst way to s^Yl^v la by airplane. 

The choice of the “most sensible” completion might bo obtained 
by a series of eductions between the above completions. According 
to Professor Thorndike this choice is a matter of “decisions" ns to 
“most sagaoioua” relations, etc. Haw the subject could make the 
“most sagacious" selection without eduction wo do not see, and if all 
such decisions, valuations and sagaoiousnoss arc ruled out of Spear¬ 
man’s laws he has instead of Laws of IntelUgonco anything but that. 



TIOTllAP-DiramRNCES FOU NON-VERBAL 
STJBTESTS+ 

WILLIAM STEPHENSON 
Oiuvcifiity f'ollpgc, TxHidon 

Introduction 

The work to l)o ch'scubed consliluloH an inLrodticlioii to intonslvo 
research on quoslion« of vorbaUty and llioughl; but the present senes 
of papers coiiccrns primarily the satisfaction of tlie ihcoiy of factors 
by data obtained by \im of veilial and non-verbal subtests. The 
question of the factor content of certain non-verbal siibtests is of 
first importance, and is our iimnediatc concorn; later, we shall examine 
comparable data foi‘ a set of verbal subtcsla, and ultimately we shall 
use the one kind of Rubtcsls as '^leferenco values"^ for the other. 

By verbal subtesls we refer to (/-tesls involving words, or phrases 
or other complex linguistic structuies as fundaments; the non-verbal 
p-tests aro sot in spatml, pciceptual, or pictorial or other ostensibly 
non-verbal fundamouta. 

Tlic recent rcsoarclic.a of Lino* and Foitos^ arc mdiciition of the 
present detailed attention given to non-vrrbal aubtosls. The interest 
in such sublosbs followa from Iho theory (niid obtamod facts) of the 
universality of the Spearman (/-factor, Lhnb which appears to charac¬ 
terise cductivo procchscs’ no matter under what conditions tlicy 
function. The work of Dtivoy® ih recalled, where tiie {/-factor was 
found to cover piotorial as well as verbal flubtc.st3. But, the correla¬ 
tional data gathered by Davey, myself,*® Lino, anti Fortes, are for 
populations of the order lOO only and, to have a more secure foundation 
of theory and supporting fact, it seems that some data should bo got 
from large populations, of the order 1000 at least. The first object 
of the present papei is to provide data galhorod from a population 
of 1037 girls 

A correlation tabic foi one thousand population servos at least 
two points of value Wo oxamino the tabic by means of the Spearman 
tetrad technique. In tlu5 first place, tho Spcaiman Thcniy of Two 
Additive Factors requires a fit m tlic toLruila to within sampling error 
value, and, insti'jul of sampling crioi of amoiml 0 03 foi one hundred 

*Wo express our iudH)(c<lnr‘ts to Piofessoj Speainmii, umloi wliom xve, 
ns Bescarcli Assislniit, c'overrd Iho juouont wuik 
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populations, we should encounter sampling error of 0,0095 for one 
thousand population (with subteats of the kind used by us). Secondly, 
it is likely that any such Theory, dependent as it is upon the use of 
many subteats, involving scores of test items, and for data gathered 
under complex experimental conditions, will need to take account of 
errors other than sampling error. Particularly will this be so for 
large populations, for resulting small sampling ciroi. It is obvious 
that as the large errois, such as that of sampling, aie cUmimshcd, moio 
and more smallei disturbances will become noticeable, wo expect this 
In our statistical and psychological material, just as wo do in physical 
experimentation Thus, the second object of oui work is that of 
furthering the investigation of cnor in tetrads, other than sampling 
error. As in physics, these enors should receive consideration in 
detail, before coirelational raatovial is submitted to complicated factor 
patterns of the land given by Professor Kclleyd 

If, from our coiiolation tables for one thousand population, the 
tetrad-differences show error in excess of sampling error, thon wo seek 
explanations of the excess, and finally may need to make it a subject 
of special investigation. If the excess cnor has a reasonable explana¬ 
tion, if it makes contact with expectations, if it can bo controlled by 
other experimentation, then the Theory of Two Factors, built upon 
the tetrad criterion, is still fully acceptable. Indeed, whoiever and 
to the extent that the excess error can be shown to bo reasonably 
expected, the theory would not bo fully acceptable unless such cnor 
did occur Thus, the two objects set for the present papei'—that 
concerning the {/-factor for a battciy of non-verbal subtests, foi one 
thousand population, and that concerning eiror other than sampling 
error—really supplement each other. 

A few sources of excess on or in tetrads have been suggested already 
in previous papeis. Excessive likeness and accidental linkages between 
abilities, and heteiogeneity of race, age, and sex, were early recognized 
by Spearman as explanations of excess error. Some amongst veibal 
subtests (attributed to similarity of the fundaments or lelations 
involved) was first observed by Davey,® and later by myself^'^ (attrib¬ 
uted to scholastic influences, in part when the population is drawn flora 
different schools or districts). Professor Spearman® has noted tlio 
influence of different scales of scoring subtests, and, unless clifficulUes 
are obviated, estimates an error of 0,01 to 0.02 as likely to accrue foi 
large populations if the subtesLs are variously scaled “Speed” 
preferences undoubtedly are a further potent aourco of excess error 
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in tetrads. IdiosyiiciaciPh inlioduccd into hul)t(*s(s when llirac arc 
coBstYUClcd by one psychologist nmy load to nior lu lUo Letiada foi 
too sul)fco.st8/‘’ and excess error may issue fn)m a piopimiuity 
effect, deiiving from (he oidei of npphcutioii of a bnltory of .suhlcsls.^'^ 
Again, theic iH poHsiblo nii mlluencc enhiiled in le.sling by gump.s ^ 
Finally, not least of the mfluciices that may lead to exce.s.s erioi in 
tetrads, tiicic are nuHtakes in eidoulaLionai work, toHt maiking, and 
application. All tlie above aie the kinda of posHilih; iliHturlianccH in 
totiads, influeiicoh leading to eiior in excess of aiimiihng eiior Our 
object is to gntlicr wbat infoiinalum we can about tlu'se, and niiy, 
influences Some may lie of psychological .significance aa objective 
specificalities, %.e., ns a group factor or fnctois, others may be trivial 
effects that further expenmculs could obviate. 

lOxi’iJur.MiA'TAn AIatjjiial 

The data to be oxaiinned arc for a non-veibal gioup test of oigliL 
aubtests, applied by myself to 10117 girls. Testing wa.s by grouiia, of 
about fifty girls per gioup, in chuneiilaiy scIiooIh * ]*)Inven scliools, 
half Llie numbci in tho legion, woic drawn fioin the ci'iilio of the city 
of NcwcaBtle-on-Tyne (ICngland). The seliools, ohusscs, mimliers of 
girls per class, luc shown in Table T The aveiage ages of tho ohihhon 
m the classes is given at the foot of llio Table. 

There weio no extitune regional differenct's in .social or economic 
status of ilie po]iulalion of girls. 'I'lio seliools wine, much alike in 
point of teaching conditions and iiUuinineiilH. Tlie small aiea covered, 
comprising the contin and gieatei part of the city, and the localising 
effect of the city’s adininistialion, combined to give tho popuhition a 
distinct homogeneity in renpoet to infliiences of liie kmdjuHtineutionrd 

Age distribution is given m Table U Kight liundioil eighty-seven 
girls wore drawn finin f^lundaids V and VIb {roughly eiiiml classes), 
all of age falling witluii tin* range 10 yeaia to 12^2 yeais at th(‘ time 
of testing. These give to our work a large ineasuui of honiogonoity, 
BO fai RB school can be compaieil with Hchunl, m both ago and educa¬ 
tional attainnionts or innueiiees The various ela.sse.s fiom winch 
these girls came eonluined foity giils below leu yeais of ag(‘, and these 
wereretamed. 'Vo offset thet'C young bright guls, we look fifty bright 
girls from SlnmhirdH IVa, of age los.s than ten yeais, and a finther 

*Tlic author is imh'l)ted to llio t'oiiiinitlce (iih) to Mi Walling, Diici-toi of 
Education. 
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seventy-six (at random from the same IVa classes) of age 10 to 12^^ 
years Thus, one hundred twenty-six girls were from Standards 
IVa, but a large part of these were of prescribed age lange (10 to 12^^ 
years). Of the girls over 12)^ years of age, seventy-five were in the 


Tabdb I 


Soliool 

Number of girla id 

Total 

per 

aohool 

Nurrt- 
bor of 
groups 
tested 

Standard 

IVo 

Standard. 

Va and b 

standard , 

' Ylb 

Standard 

Vllb 

A 

28 

40 

22 j 


00 1 

2 

n 1 


61 

40 


; 01 1 

2 

c 1 


60 

1 31 


100 

2 

D 


68 



1 ^3 

1 

E 

3J 

i 66 



' 03 

2 

P ' 

10 

1 68 



1 iis 

2 

G 1 

14 

i 36 


23 

1 112 1 

2 

H 


1 60 



07 ' 

a 

I 


1 34 

63 

1 

88 1 

2 

J 

0 

61 

27 


04 1 

2 

K 

20 

66 



01 

2 

Totals per sUndarcl, , 

120 

687 


21 



Total all standards 


, 


, 

1037 


Avoraga ago per girl 

10 yr 2 mo 

10 yr 10 mo 

1 


12 yr 6 mo 




Taplei II—Abb Distribution for 1037 Girls 


Aqb 


(Ybars, Months) 

Fukqiiiiitcy 

8- 6to &-11 . . 

5 

0- 0 to 0- 5 ,. 

21 

ft-0to 9-11 , . . 

61 

10-0 to IQ-6. .. . . 

111 

10-a to 10-11 , , , . . 

160 

11- 0 to 11- 6 . . , 

200 

ll-6toll-U 

185 

12- 0to 12- 5, . 

109 

12- 6 to 12-11 

00 

13- 0 to 13- 6 . 

24 

18- 6 to 13-11 , , . . 

6 


various Standards V and Ylb The girls entered from Standard 
Vllb of one aohool could be omitted without altering any of the losults 
reported in the course of our woik 

The non-verbal group test was applied in June 1929 Each testing 
group received the verbal group test on one day, followed by the 
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non-verbal (our paiticular concorn in the present paper) on the next 
day. Altogether, 1037 girls leceived both group tests. 

The Non-verbal Suhtests —The group lest had to be easily applicable 
in forty minutes full testing time. Tho subLesLs therefore had to be 
of simple constiuction, and we anticipated rathei low intercorrelations 
for some of the subtests; on tho other hand we expected that two of 
tho subtests would be fairly highly (/-saturated (No. Ill and No V). 
The names of tho subtesls, in ordci of application to the giils, with the 
time allowance and number of test-units per subtest, were as follows: 

I Alphabet Construction 3 minutes, 10 teal-umta 

II Code 2 imnu tea, 8 lines of code, scoiod per half-liuc 

III. Filling Shapes 5 minutes, 15 tcst-unita 

IV Ptcluro Completion' 3 mmutca, 15tcgt-iinits 

V. Analogies, Form' nunutra, 10 test-units 

VI. Counlmg Cubes minutes, 16 test-units. 

VII XO .Series Completion. 3 minutes, 16 tost-umts 

VIII. Overlapping Shapes 3H minutes, 24 test-umts. 

Throughout our work, we shall lefer to these subtests by the Roman 
numerals I, 11, etc. A brief description of each subtest follows; 

In subteat I tho testeo wns given a capital letter, and m imagination a piece had 
to bo cut away, leaving as remainder any other capital letter If R was given, 
P could bo tho loquuccl response I's wore debarred, the given letter could be 
unusually orientated (as A thought of na V)/ and ono, two, or moie pieces could 
bo cut away (m imagination) The given letters were of simple prmtmg, three- 
fourths moll high. A sample test-unit le shown in Pig 1, m which three different 
responses are expected Tho oapitala used were, in order, X, U, A, H, B, S, Q, 
P, W, B, and the number of responses expected m each wore 1,1,1, 2, 3, 2, 3, 6, 3, 
and 8, respectively In marking we allowed one mark each for test-units 1, 2, 3, 
and 0, and two marks for the rest, Nos 4, 6, 7, 8, 9, and 10 In the latter teat- 
units one mark was allowed for half or more correct responses, In. explaining the 
subtest, which appears to be icadily understood, use wns made of sample capitals 
Y, D, and M, providing V, h and C, and V and N, respectively The sainples 
were worked thiough on a black-board, following a standard procedure 

Subteat II was the Code of tho National IntoMigenco Group Test, n sample of a 
Similar kind of aubtest being worked through on the black-board 

Subtest III can bo undcistood by refemng to Big 2 Thiee small shapes are 
given (togothei, to the left), which, when properly fitted togetlier, form the larger 
shape (on tho right) Lines had to ho dinwn in the larger shape (right) to indicate 
how it could bo out to give tho thico small shapes A correct lespoiise lequired 
tho drawing of no moro Uian two or thioo lines iti any test-unit Pour sample 
teat-uiuts wero woikcd tinough on tho black-board 

Subtoat IV wns of tho usual pictuio completion typo, for example, a cup may 
be given winch is minus its handle, and tho teslee is acquired to indicate the 
missing part 
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Subfcost V, an Analogies subtest, made use of shapes and linos m variouE 
relations ono to another A sample teat-umt is given in Fig 3 The task oi 
explaining tlie subtest’a requiremoats was rendered easy by referring the girls to a 
verbal analogies subtest given to them ou the previous day 

1 2 3 

Pi({uro 1 



Pil^re 2, 


Subteat VI was a modified form of the Amciican Aimy sub test of tlua name 
Subkest VII, a seiies completion subteet, can bo undoi stood by rcfeinng Lo 
the sample below 

xxoxxoxxoxxo- 



Figure A 



The four dashes had to bo filled in bo os to continue tho senes, ^‘X X 0 X” bouig 
the required responses in tins sample. 

Subtesfc VIII required a little more preliminary explanation than was needed 
for most other subteats. Figure 4 shows the type of test-unit. All the shapes 
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overlapping tho 1 Imd to bo indicntcd hy cancelling theappiopiiateBliapcs adjacent 
to No. 1 on tlio light A large square, a long reclanglo, a long thin tiianglc, a 
circle, and a 'Tive-flided" figure (logular pentagon), were the elmpea made use of m 
each tcat-unib. In tho case of the sample shown m Tig. 4, the equare, triangle, 
and circle, rccpiired cancelling. 

Tho subtcsls have boon described for adult understanding, but the 
testing directions were much more cliildliUc and concrete Applica¬ 
tion was standardised to an easy facility, and tlie sublests were given 
with this regulauLy thioughout. Each subtest was piefaced by a 
forc-practicc of six or so test-units, worked through on tho class 
black-board, altogether fifteen minutes of the foity minutoB testing 
time was so spent in giving directions and woiking the sample test- 
units. Eor each sublcst tho girls were allowed about fifteen seconds 
to settle to be ready for the command "Go,*' each girl fingering the 
page ready for turning (cyclostylcd sheets, stapled in the top left- 
hand corner, aie quickly turned over, leaving the subtest exposed), 
and WGiG brought to a stop with an energetic "Stop” command I 
had gioup-lcsted many hundreds of bo^and girls previously. 

Subtests I, II, IV, and VII, occupied one sheet of paper each (quarto 
size), while tho I’ost requiied two pages each; but m the latfcei cases 
the two pages of tcsb-imits faced each other, and appeared to the girls 
as one double-sized page in each case. Theic was, therefore, no page- 
turning during the time allotted for working these subtesta. 

Enquiries elicited that no gioup tests had been applied to these 
gills previously. 

iNTUnCORRBLATIONS AND TeTR AD-DIFBEnENCBS 

Interconclations for tho eight non-verbal subtesfcs were first cal¬ 
culated for crude scores, using the formula for differences (Kelley® 
p 180) All calculations weie checked in vanous ways, but tho ques¬ 
tion of mistakes receives attention later. Table III gives the product- 
moment correlations for the eight non-verbal subtests, with age, £oi 
1037 girls. Those we are to consider m teims of the Spearman Theoiy 
of Two Additive Factors. 

When wo arc conceined with tetrad-diffeiences for a table of intei- 
corrclations, wc calculate onc-holf the number of tetrad-diffeiences 
possible for tho table (the other half aie identical in value, but of 
opposite sign) Tlie mean of this half-number of tetiad-differences 
is thus the average or mean deviation about the mean of the observed 
differences. 
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For the theoretical PE of tlie tetrad-differences we use formula 
16A (Spearmanj’ p. xi) Foi exact comparison -with ihis theoretical 
PE we calculate the observed probable error, given by 0.6745 a/ 
where t stands for "tetrad-diffeience,” and n is the number of tctrad- 
differencea. 

If "normal” probability distribution obtains for the observed 
tetrad-diffeiences, the above inean deviation about the mean of the 
obsci'VGcl tctiad-diffeiences, multiplied by 0 8453, gives the value of 
the probable enoi for these obseivcd tctiad-diffcrcnccs We antici¬ 
pate that this latter value should be appioxunately the saino as that 
given by the sigma above 

For any set of tetiad-diffcionccs, then, \vc can give (aud it is our 
usual practice to do so tliioughoufc oui woik) the following values' 

(o) Tlio viian of the httlf-numbei of tctmd-dilTciCiicos, sign being disicgaidccl 
This IS the mean deviation about tlio mean, oi average, of tho full sot of tetrad- 
differences, when regnid is paid to sign, the avciago of the full sot being ^eio 

(6) The piobable crroi of tlio cliflferonccs, calculated from the above »nca«, 
i e, from tho mean deviation, %.e, 

* 0 8453 X Mean deviation 

(c) Tho piobable error of tho dilTcrenccs, calculated from tho obaoivod aigma 
of the differences, i e , 

fw » 0 G745\/IL* 

» n 

(d) The thcoietioal probable error, ahvaya oxpicssod as PB, given by equation 
16A (Speaunnu), 

From Tabic III, before age is pnrtiallcd-oufc, wo obtain the following 
results for the tetrad-differences. 

(o) JV/ccw of 210 totiftd-diffcrcnocB . 0 0232 

Q}) Observed jie, fiom wean X 0 8463 . 0 0106 

(d) Theoiotical PE ... . ,. 0 0006 

If we partial out the age correlations, the new intercoiielations for 
the eight non-vcibal subtests give the following lesulta 

(a) Mean of 210 tetrad-diffcrencca, age pai tiallcd-out coi ic- 

lations . .. 0 02266 

(b) Observed piobableeiroT,from 0.8453 X the above ineou 0.0191 

(c) Observed probable error, from 0 6746 X sigma 0 0184 

(d) Theoiotical PE . . ... . . 0 0094 

Thus, as a whole, the mtercorrelalions show evior in excess of that 
expected as sampling error, the excess being of the order 0.016 Pur- 
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ther, age has no significant influence on the tetrads heie consideied. 
Our immediate pi oblem, then, la the attempt at location of this residual 
excess crroi 


Location op the Excess Ernion 

When the tctrad-diffeiencea show excess error it is our first object 
to tiy to explain the excess, in terms of specificality, e.e., of a group 
factor 01 faclois, oi in terms of extraneous influences, such as calcula¬ 
tion mistakes. Some possible spccificohlios and influences have been 
dcsonbed in the IntioduoLion 

Without going into details, it may be said lieie that there is no 
evidence that any of the influences mentioned above (with exceptions 
to be considered below) have singly pioduced the residual erior. 
Thus, the effect of te.sLing by gioups was found by me to be here with¬ 
out influence on the tetiads. Again, subtests III, V, YI, and VIII 
have somewhat similar shapes as fundaments, but there is no evidence 
of a broad gross specificality because of these fundaments Subtests 
III and VIII involve very similar geomcti’ical figures as fundaments, 
but specificality is not shown by We guarded against “pio- 

pinquity” influences in oui testing procedure, although we would not 
be quite ficc fiom an habituation distuibance fo-r or j’jju 
From the way in which the interesting subtests (judged from the girls' 
attitudes towards the tests) weie mfcroduced m the battery, and fiom 
the shoit testing time entailed, wc can neglect possibilities of fatigue, 
subjective or othciwise, cntcimg our material No matter what we 
attempt, we can not isolate any single coirelation and submit that it is 
associated with the laiger, oi gi’cater part, of the excess error shown 
by the tetiada, Thus, in a piebminaiy search for possible disturb¬ 
ances there remained two for consideration, fiist, the possible calcula¬ 
tion mistakes, second, the possible cnor introduced by dissimilai 
scales, by faults in scoie distributions. 

If, by lecalculatmg intei’coiielations for new scales (a new dis¬ 
tribution of scoies foi each subtest, without distorting the sense of the 
scores), we finally rid the tetrad-differences of excess erior, the whole 
procedure will be open to the criticism that the mlercoirelation tables 
vaiy slightly one fiom another, due to calculation mistakes, so that 
the final removal of the excess eiior would bo considered to be merely a 
happy chance in the calculations. But, at least, we shall sec the extent 
Within which such variations due to calculation mistakes can bo 
taken to be of influence in our work; and, should our proceduie show 
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orderly diminution of the observed totrad-diffcrcnces, some evidence 
will have been obtained for a fau' measure of soundness in the calcula¬ 
tions, and for the supposed influence of the irrcgulai disfcubutions 
of scores 

TJie Suhiesis Rescaled .—^We proceeded m two atagea. First it 
woB thought perhaps flufficient to icscalo the subLoata so as to give 
approximate “normal” distributions of scores for the 1037 girls 
When it was found that this approximation failed to give the expected 
improvement in the erroi shown by tetiads, we subsequently converted 
all crude scores into a “standard" normal distribution, the same for 
each subteat. Using new coirelations for seven of our subtesta, each 
aubteat having an approximate “normal” scoic distubution, gave a 
mean of 106 tetrad-differences of amount 0.0229; this is to be com- 
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3251 

vni 











pared with the value 0.0234 observed foi the same seven subtests 
with the intercorrelations of Table III The average of the twenty- 
one mtercorrelations for the new table was 0.3698; the coriesponding 
average for Table III is 0.3614 (subtest VI omitted). Thus the 
rescaling to an approximate “normal” distribution (amounting to 
removal of any “skewness ”), does not iid us of the excess error in the 
tetrads. Nevertheless it perceptibly altered the mtercorrelations, 
m the direction, of a smoothmg-up of the table of mtercorrelations, 
giving better “hierarchy.” It appeared that just another such slight 
smoothing would bring the totrad-diffeiences to within sampling 
error values 

p It is not expected that crude scores sliould have miicli more exact 
“normal” distributions of scorea than those obtaining for our sub- 
tests. But the number of girls ^ven zero score in particular subteats 
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IS fiequently dispioportionately large and, when the test-units of a 
siibtest aie nob sufficiently smoothly graded, the short timc-allowancc 
per Bubtest tends to accentuate the frequency of certain scoies Dis- 
tuibances of this kind may hide the gcneial results that aie our 
concern. To take into consideration influences of this kind wc con- 
sidcied it worth while trying our data with new scales, this time fitting 
each subtest to a more exact “normal” distiibuLion, the same for each 
subtest. 

I'or convenience the six subtosts I, II, III, IV, V, and VIII wcie 
made the subject of the new convcision The crude scoies which 
supplied Table III wcic now converted to fit exactly the following 
approximate “noimal” distribution. 


Score 

0 

1 

1 

1 

4 ' 

sl 

0 

tI s' 

o' 

10 ' 

11: 

112 ' 

13 ' 

U 

n 



Frequency . . 

3 

1 

1 

1 

48 

70 

08 

I18|l36j 

134 

1 

118 

98| 


48 

24 


I 

E 


The method u&cd in convciting the ciudc scores will be understood 
by referring to the following example of the proccduie 

The crude scores and frequencies for subtesfc I wore as follows: 


Crude scoica 

0 

1 

2 

3 

etc. 

Frequouoy. 

2 

10 

27 

32 

1 oto. 


Of the ten giils obtaining crude score 1, one was chosen at random, 
and her scoie was reduced to aero [making, with the two having zeio 
crude score, tlie three ncw-scalc 0 scoies required for the "normal” 
distribution (for convenience wenamo this distribution the “standard” 
one)] seven of the girls retained their score 1 (now taken as new-soale), 
and the othoi two received new-seale score 2 We now require four¬ 
teen more ncw-scale 2’s. these were taken at random from amongst 
the twenty-seven having ciudc score 2, leaving thii teen. The thirteen 
arc acciedited with a score 3 on the new-scale Similarly eleven of the 
thirty-two crude score 3's are given ncw-scale 3’s, and the rest arc given 
new-scale 4’s This process is repeated up to the inaxiTnum score, 
17 ncw-acnle, all the selections within a particular crude-score being 
made at random. It i.s obvious that the new scaling is icasonable 
in that it does not distoit the sense of the subtesls, and it is valid, 
having in mind the nrbitraiy system of allotting crude scores 
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The six subtests so rescaled provide the intercoi relations given in 
Table V, age being neglected. (It seems that age influence, for all 
our tables of correlations, ivould intioduce at most about O.OOQ error 
in the tetrads See in this connection Holzingcr/ p. 28) The sub¬ 
tests give tetrad values as follows: 

(a) Mean of 45 tctidd-djlTcionccs for Table V 0 0188 

(5) Obscivod probable error, given by mea7i X 0 8453 0 0159 v 

(c) Observed pe, given by sigma X 0 6745 . 0 0171 

{(1) PE . . 0 OOOG 

These values show impiovement when compared with coiresponding 
tetrads for Table III But the impiovement is greater than the 
above observed probable eiioi evinces One correlation, ru^vm, 
has associated with it the larger of the tetrad-differences. If we omit 
the twelve tetrad-differences involving this correlation, we aie left 
with the following 

(a) Mean of 33 tcttftcI-dilTejcnoes for Table V, omitting 


^ii.vin 0 0104 

(&) Observed probable cuoi, given by mean X 0 8453 0 0088 

(c) Observed pe given by sigma X 0.6746 0 0080 

id) PE 0 0005 


The observed probable error (0 0088) is now attiibutable solely to 
sampling error It seems that the improved distribution of subtest 
scores has removed crroi in the tetrads, other than sampling, and tlmt 
due to as we see from a eompaiison of the values at (a) with 
corresponding tetrads for Table III. Thus the forty-five comparable 
tetrads for Table III (crude scores) have the following values; 

(o) ilfean, fotty-fivn tctiod-difforences tor Table III. 0 0244 

(6) Obsei ved pe (mean X 0 8463) , 0 0206 

id) PE 0 0100 

Again, if we omit from these foily-five tetrads the twelve that involve 
the correlation rn,vrn> we ate left with the following values, foi com¬ 
parison with the observed probable enor of amount 0 0080 for Table V: 

(o) Mean of llinby-ihiee totrad-diffcranocs, for Table HI, 


subtests 1,11, 111, IV, V, and VIII, omitting rjj vm 0 0191 

(!)) Observed probable enoi, given by mean X 0 8463 0 0169 

(c) Obsemd piobablo enor, given by aigma X 0 0746 0 0109 

id) PE nearly , q qoOS 
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Values quite similai' to these for Table III were obtained also foi 
the table of iatoi coi relations alluded to at the beginning of this section, 
where seven subtests were icsoalcd to an approximate “normal” 
distribution of scores. The value 0.0169 at (c) above is for ciude 
scoro corrclationa, whilst 0 0080 at (a (c)) is for “standard” normal 
probability distributions of subicsl scores; wo conclude that the 
improved distiibution of scores has removed excess on or in the tetiads 
(excepting influence of the cinde scores is likely to be 

of amount 0.0149 (given by -\/oibl69’* — 0 0080“). Tins, we note, is of 
amount estimated by Professor Spcaiman as likely to acoiuo for large 
populations if subteats are variously sealed as mentioned in the 
Introduction to this aiticle. 

Table IV —Means and Sigmas or tub NoN--vi3fiflAL Sudtebts, tor N “ 1037. 

Girls 



We conclude, then, that the observed probable error given at (a) 
above for Table V, is as low as we can reasonably work for, and the 
tetrads provide sampling error differences only; to complete this 
conclusion, however, we must explain the excess error apparently 
shown by the correlation 7ii.viii Further, it appears that the rescal¬ 
ing, to fit a “standard” "noimal” distnbution of scores, has effected 
the improvement in the erior shown by the tetrads In this connec¬ 
tion we should note the following contiibutoiy evidence The means 
of the corresponding inbcrcorrelations m Tables III, that alluded to 
for seven subtests with approximate “normal” distributions, and V, 
arc 0.3614, 0.3598, and 0.3527 respectively—these values, wc suggest, 
offer an example of the fair quality of the calculations, and this 
receives confirmation m other directions, for instance, fiom the 
objective spccificality (considcicd below) for ?ii,viii Wo can not 
readily consider that a happy chance has resulted m the impiovement 
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shown in the observed erroi at (a). Calculation errors theie are, no 
doubt, but they are too fine to be significant m our tetrads 

To complete our account of the factor content of the non-vcibal 
subtests we require to explain the excess erior apparently shown 

Considewlion of the ru^vm Specijicahly .—-One would not place too 
much regaid upon a single case of diveigence from sampling erroi 
values, and usually the details we are about to give would scarcely be 
necessary. But, the excess error attributed to ru^vm can receive a 
simple explanation, and the spocificahty can bo shown to bo objective, 
it la a matter of importance to rcpoit the data concerned, for reasons 
connected with the acceptability of the Two Factor Theory for our 
data, for the contact it makes with the investigation of eiror other 
than sampling error, and for the evidence provided of the objectivity 
of the coirelational values under consideration. 

Table V —PiioDUC'r-MOJiENT Cobublations Non-verbaTj Hubtertb, with 
S coBES Converted to a "Standard" Nor&iai< Piiobabiuty Distribution 

Jf = 1037 Girls 


Sub lest 

II 

III 

IV ! 

V 

VIII 

I 

3'lfl3 

4121 

3274 


3207 

II 


3484 

2074 

3707 

III 



4110 

4711 

3608 

IV 




3771 

3012 

V i 





3278 

VIII 







We have suggested that Jn vui is "l-he source of excess eiror in Table 
V We do so by noting that the largest tetrad-diffeicnccs for Table V 
uniformly involve this coriclation Tetrads of the following type 
are then isolated, and omitted fiom the mam body of tetrads 

(Tau ^»b) (fA* I'Bs) ~/ \ 

(tab »•*») " {tau Tj»,) = /' J ^ ^ 

(where Tab is suspected for excess error, and where x and y are any 
other subtests, taken two at a time, regard being taken of the sign of 
the difference). The twelve tctiads of this foim for Vab = hi.ymt 
for Table Y, have mean of amount +0.0420. 

Now, there is evidence from other sources that strengthens the 
claim of the luvni excess enoi to a fan degioo of objectivity Tlio 
evidence is as follows: 
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In the table for crude scores, Table III, lias the largest mean 
associated with it, for tctiads of form (1), namely an amount +0 035. 
Again, coriclations woikcd for a Bub<populaUon of two hundred girls, 
a selected gioup with ages ranging 10-9 years to 11-3 years at the time 
of expeninont, gave the following results: 

(a) Mean of two liunclrod ton Icliad-diffcrcnees, aiib-popvi- 

lation of two hundicci, oigiitnoii-vcrhn.laiibtcsts 0 0310 

(b) Obficrvcd probnblo ruor, given by mean X 0 8453 0 0270 

(d) PE . 0 0230 

There aic thirty tetrads of foim (1) for r„^vm this two hundred 
ten tetrads, with mean of value -f-0.0737; the omission of these thirty 
from the full tabic of totrad-differcnccs leaves the following results: 

(a) Mm\ of one Imndrocl oigliLy totind-diffcrenccs, eub- 

population of two humlicd girls 0 0248 

(b) Afcan X 0.8463 . . 0 0210 

(d) PIS . . , , . 0 0280 

Other correlation tablos, for feub-populntions of one hundred girls, and 
five hundred girls, gave similar results. The most noticeably large 
tetrad-differoncos always involved the correlation rnym, and the 
omission of this correlation left tetrads with sampling error values 
only. The result shown for Tabic V, then, is not particular to that 
table of coviolationa. The excess error associated with ru^vm is 
independent of the scoiing methods used in ouv work; and the obser¬ 
vation of its mfluciicG is undoubtedly repeatable, t.e., objective. 

An acceptable specificality between the two sublests II and VIII 
can be explained m terms of a “quantity-work," oi “speed," prefer¬ 
ence The Code subtost (II) may be liable to a pionounced prefer¬ 
ential attack for “speed" os against “quality,” Subtest VIII would 
seem to entail a similai piefercnce on the pait of the testecs One girl 
may diligently ensure that each test-unit in Bubtest VIII is completely 
and surely answciod, all the oveilapping shapes being sought for. 
Another girl may be satisfied if one or two overlapping shapes are 
found, and would spend no time m a search foi further shapes The 
former may respond to five test-units only, maikmg probably fifteen 
figures that overlap, without a single orior or omission; the latter may 
1 espond to all twenty-four test-units, marking foi ty overlapping figuies, 
but with not a single test-unit correctly answered A differential 
influence of this kind has been obseivcd frequently in other work, m 
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researches made in our laboiatory 171111 our present maleiial, we 
have a test of the "explanation”, and we next give this attention. 

Subtest VIII was scored for quality (<3, completeness of answer), 
and for quantity ( 7 , total number of shapes coriectly indicated, coi- 
rected for chance correct responses). The scores wcic added, giving 
equal weight to each, and (Q + q) was then the crude score for subtest 
VIII, used 111 all work described in the previous sections The sep¬ 
arate 0 and q scores, however, give us the following additional data- 

(1) The correlations rit.r, and aio 0 4088 and 0 8217 respectively 

(2) tq, is 0.8505 

(3) Using tliG Q ficoie only, the following new coi relations were cnloiilated, all 
scores being sot on the "atandaid” normal diatnbution excepting Q 

*■ 0 . 1 , ro.if, ro.iv, lo.v, having values 

0 3230, 0 3217, 0 3216, 0 2652, and 0 3232, icspcctivcly llcplacing tho 
correlations /oi subtest VIII m Table V by the coi responding ones given 
above, gives a new set of tctmd-dilToicnecs, with value as follows. 

(o) Mean of 46 tctrad-clifforcnocs, Table V, having Q in 
stead of VIII 

( 6 ) Obsoivcd probable orroi, given by mean X 0 8463 
(e) Observed probable error, given by sigma, X 0 0745 
(d) PE ivoaiiy 

The twelve tetrads of foim (1) for tho correlation iji,© have moan of value 
0 0261 Tho above values should be compaiod with tho values given at (|9) on 
page 178; and the mean 00251 likowiso should be compnicd with tho mean of 
0 0420 given on pago 180, for tho tetrads of form (1) involving rn.o and rn.viii 
respectively. The use of Q gives lower 01 lor m tho tetrads. 

(4) With the corrclationB already piovidcd, it is poasiblo to calculate tho 
following correlations 

^IH.w *’lV,flr *’V,9 

These have values 0.2940, 0.4088, 0 3610, 0 3142, 0 3074, respectivoly As afc 

(3) given, we replace the coirolations for tho aubtest VIII m Table V by those q 
coTTclations Tlic resulting table of corrolationB provides Eorty-fivo tobiad- 
difTerences, with value much the same as those given above at (3) for the Q corre¬ 
lations, except that the twelve tetrads of form (1) have moan 4-0 0645 This 
value should be compaied with the 0 0261 for the Q-measure tctiads of foim ( 1 ), 
and with the (Q + 17 ) measure value of 0 0420 

Thus, it seems, from the eonsidernUong wc have given of tho matter 
m the above paragraphs, that the Bpccificality shown by J'lr.vm has a 
fair degree of satisfactorincss, owing moat to a common influence 
between subtest II and tho g (quantity) measure of tho subtosL VIII. 
Tho excess erroi for the tetrad-differences of Table V, which wo asso- 


0 0152 
0 0128 
0 0128 
0 0006 


(7) 
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cifttcd with I’livitii is shown above to be repeatable and therefore 
objective (within the limiLa of our data for the 1037 gills); similar 
crior has been found in other work, in which a similar explanation in 
terms of a “speed” effect has been offered; the explanation seems 
reasonable for the two subtesta concerned; and it lecoivcs expeiimental 
support from the Q and q coiiclations. Thus, the speoificality 
IS well authenticated. 

Further, this "speed” specilicalily scorns to bo the only one that 
can be isolated for Table V. llclevanl to this conclusion we should 
add the following details. 

One may envisage a complicated cancelling, in the tetiads for 
Table V, wheioby tlio oorielalions r,„xvj ’niv» fii^d riryj,,, cancel 
out (except for the latter) any mflucnco that each may have separ¬ 
ately towards excess crior. If we omit all tetrads involving these 
four correlations, wo arc left with only eleven of the forty-five tetrads 
for Table V, with mean of amount 0 0083, observed probable error 
of O.OOG9, theoretical PE of 0,0094 But wo are not justified in 
suggesting the isolation of correlations that already give only samp¬ 
ling error value to tetrads. However, so fai we have been critically 
concerned with only six of oui eight non-verbal subtests; if need be, 
wc could widen our data by including the two subtests so far not 
rescaled, Iheieby perhaps obtaining further infoimation about the 
effect of any, or all, of the four correlations considoied above. There 
is reason to suppose that if subtests VI and VII were lescalcd, they, 
too, would fall into line with the values and charactonstics shown by 
Table V; thus, subtest VI was included m the coirclaiion table alluded 
to in this article under “The Subtcsls Resoaled” (foi the seven sub¬ 
teats with approximate “normal” distiibution of scoica), and it fits 
the tetrads ns well as any other subtests; and, further, subtests VI and 
VII had clearly the most irregular ciaidc scoie distiibutions, which 
amply explain the con elation anomalies they show in Table III 
Until we find clear need to seek furthei information about the above- 
mentioned correlations, or any others, we propose being satisfied with 
the data obtained already for the six subtests in Table V 

The correlation j’my requires a moment’s consideration because 
of contact made with it m the course of woilc to be dosciibed m a 
subsequent papci Wo may state, without going into details (a 
matter that can be examined by anyone so interested, since all the 
necessary data aic piovidod in this paper), that Jm.y in no way 
singular m its clTcots in tetrads No mattei from what angle wc exam- 



184 The Jownal of Educalional Psychology 

ine our data, we obtain no evidence in support of spocifioality for 
riii,v. Parenthetically wo should add that in any detailed examina¬ 
tion it should be remembered that the Q measure for subtest VIII is 
biased for qucdiiy (with the narrow conception given to this woid, 
namely, “completeness of answer”), and this slightly disturbs corre¬ 
lations with Any need to consider (or riiu, etc.) as a 
possible source of excess error, is lemoved if the Q oi ^ scores are 
neglected 

We conclude that ru.vm, m Table V, alone involves acceptable 
specificahty. 


Kiisuiifs A15D Conclusion 

Commencing with the intercorrelations of Table III, which piovidc 
an observed probable eiror of 0 0196 for tlioir totrad-diffcrences, wo 
have endeavored to locate error of amount about 0.016 in excess of 
that expeotod for sampling error (0.0006). If we were able to explain 
the excess error satlsfaetorily, then wo are left to conclude that the 
inteicorrelatlons for the non-voibal subtosts have good agieoment 
with the Theory of Two Additive Factors 

Of first importance is the question of our calculation mistakes. 
The sequence of error for tetrads for Table III, that alluded to for tho 
seven subtests with only approximate "noimal” score distubutions, 
and for Table V, as well as the play of eiror for the vaiious mQuences 
considered in the pievious section are the evidence that wo offer of the 
quality of our coiielational calculations. Wc cannot hope to be free 
entirely of caloulational error; but, we add, the correlation calculations 
should bo accepted even if our tetiacl calculations are found slightly 
inaccuiate, because the coirelationa have leceived tlio gieater atten¬ 
tion Further, oui data are lodged pormaneully in the Psychological 
Laboratory, University College, London, and aie available foi anyone 
to rework. 

Neglecting possible calculation, mistakes, and age influence (which 
IS no doubt present, but introduces veiy little erroi, of amount 0 005 
at most), we account for the excess erroi of Table III tetrads as 
follows. 

First, there is eiroi introduced when the gublest scores are not 
distributed satisfactorily “normally,” When tho crude scoies aie 
converted to fit a “standard” noimal probability distribution, the 
excess error is removed, except for a single specificality that can be 
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isolated and expliunod Neglecting this single specificality gives an 
observed probable onoi of 0.0081, for a Uicoretical PE of 0.0095, 

We show that this single specificality, for ni.vinf la objective, and 
acceptable as the only Bpccificnlily among our non-verbal subtests. 

The Theory of Two Additive Eaclors therefore fits well with the 
observed leBullfd for our non-verbal sublcets, allowing for r,;,virr We 
explain the intoicoi relations m terms of a common (^-factor, and factors 
specific to each subtosl (with spccificalilij for r,r,vm). The p-faclor 
we take to be that first observed by Piofessoi Spearman, the factor 
that appears to churactoiisse iclation and coirclato eduction. Thus, 
the p-factor hitherto observed for non-verbal subtests for small 
populations, is hero shown to obtain for ono thousand population. 

Finally, conccining our second object, that of knowledge of error 
other than sampling enor, we can hcie say that the facts can best 
be given on completion of our work, with the verbal subtests considered 
in addition to the non-vcibal At this junctuic wc note that, accept¬ 
ing our correlations, it is possible to obfeorvo the infiuenco of non- 
normal disiribiiUon of scoiCR for the subtesLs. Our second point of 
note is that we isolate a single specificality, attributed toa^speed pref- 
eioncG " Such a "speed” effect must be looked foi m all woik with 
p-tests; and thcinnuoncc must be keptm mind particularly in our work 
with the vcibal subtests 
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A COMPARISON OF 'WHITE AND NEGRO CIin^DREN: 
NORMS ON MIRROR-DRAmNG FOR NEGRO 
CHILDREN BY AGE AND SEX 

U J, CLINTON 
Oregon Stato College 

A gieat deal lias boon witlen and said by way of coinpiumg the 
white and Negro races, both m menial ability and motor ability 
Ragsdale* said that there was not much diiTcrciico in tlic ability of 
white and Negro boys, m the rate of tapping, “although theic seems 
to be a slight tendency for white boys to be supciioi at the later ages/’ 
He found that Ihero was not much difference in the rate of tapping 
of white and Negro gills until the ninth year when "white girls are 
consistently superior m tappmg rate " ‘Waltner’^ states; "This study 
of the learning capacity of Negroes as compaied with whites finds the 
power to form sensory-motor coordinations by Negroes to be about 
72 8 per cent that of whites.” 

Bardin^ obseived that the anatomy and physiology of the Negro's 
brain hindered him m learning Joidon’s^ personal observation was 
that the learning capacity of the Negi'o could bo determined by the 
darkness of his skm. Phillips® suggeslcd lelardalion ns a ciilcnou 
for judging the ability of Negro childien. 

Schwegler and Winn® studied a group of 58 Negro boys and girls 
and a like number of white boys and girls in the Junior High School 
of Lawience, Kansas The selection was by chance. They state*. 

There Bcoma to be an nnwiistakablD difforonco in the inlollecUial lifo ol tho two 
groups stuchec] Tho median intellectual emlowment of tho colored gioiip is 
about eightr-fivc per cent of that of the white gioup 


1 llagsdalo, C E . "Psychologyof tho Ncgio ” Thesis, Univciaifcy of Missouri, 
p. U4 

^Waltner, Eima “Psychology of Negio'* Tbeaia, Univoisity of Missouri, 
p 36. 

sBaidin, J . Factors m the Southom Race Proi)lom P Sc M , 1913, Vol 
LXXXIII, pp. 368-374 

* Jordon, II E : The Biological and Sociological Worth of tlio Mulatto 
P. 5c. M., Vol LXXXIII, pp. 673-682 

® Phillips, B A Retention in Elcincntaiy School of Philosophy Psycho- 
logical ClwiG, Vol, VI, p 79 

®Sohwcgler, R, A , and Winn, Editli Compariaon Study of White and Coloicd 
Children Journal Educahonal Research, Vol H, pp 838-847. 
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The wiiter became interested in the studies cited and desired 
to make a comparison of the abilities of white and Kegro children^ 
in mirrow-drawing, motor speed as shown by marking, and letter- 
forming speed as shown by writing, as well as to make some compari¬ 
sons of the mental abilities of the two laces 

By means of the use of the Otis Self-administeimg Teat of Mental 
Ability, the writer made a comparison of the mental abilities of an 
unselected gioiip of white high school pupils, and an unselectcd group 
of Negio high school pupils. The one hundred fifty-five white 
high school pupils gavo a mean IQ^of 100 5, and the one hundred 
twenty-two Negro high school pupils gave a moan IQ of 84 5 

Method of the Study 

The muroi-drawmg equipment® oons^ted of a stationary mirroi 
on a drawing board, and a small shield to prevent the subject fiom 
looking directly at the hand while working The miiroi-drawing 
pattern consisted of a two-circlc pattern with numbers fiom 1 to 24. 
Numbers 2, 5, 8, 11, 14, 17, 20, 23 make up the small inner circle, 
and numbers 1, 3, 4, 6, 7, 9, 10, 12, 13,16, 16, 18, 19, 21, 22, and 24 


Table I,—Compakibon of White Bot.s and NBono Boys fhom Six to Seventeen 
YeATIS of AqB in MniROB-DHAWINa 


White boys 

Negro boys 

Ago 

Numboi 

Mirroi- 

diawing 

Ago 

Numbei 

Mil ror- 
drawing 

6 

38 

4 7 

C 

19 

1 7 

7 

36 

6 6 

7 

21 

2 9 

8 

49 

0 1 

8 

25 

8 2 

0 

27 

9 4 

Q 

28 

6 8 

10 

43 

10 5 

10 

22 

7 2 

11 

30 

14 0 

11 

21 

9 7 

12 

40 

14 7 

12 

28 

8 3 

13 

32 

15 8 

13 

28 

8 2 

14 

44 

20 1 

14 

10 

16 2 

15 

34 

22 4 

16 

23 

10 8 

16 

46 

24 9 

10 

16 

9 3 

17 

49 

30 8 

17 

10 

16 6 


* The wiitci included 6D1 Negio children m this investigation 

* Clinton, n J Natuie of Mirroi-drftwing Ability Norms on Minor-drawing 
for White Childien by Age and Sex Journal Educational Psycholoijy, Mar,, 1930 
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make up the laige outer circle The subjects wcie instructed to draw 
a continuous line from 1 to 24, cutting the small dot at each number. 


TAUIiB II—COJIPARISON OF WUITB GlRLS AND NBauO GlULS FROM SiX TO 
Seventeen in MuiROR-DiiAwiNG 


White gills 

Negro girls 

Ago 


Mill 01'- 
diawiiig 

Age 

Number 

Miuoi- 

<lmwing 

6 

28 

2 9 

6 

17 

1 

7 

41 

4 0 

7 

18 

4 9 

8 

63 

5 9 

8 

24 

3 7 

Q 

28 

8,3 


32 

4 6 

10 

44 

8 0 


37 

0 9 

11 

49 

10 9 

11 


5 3 

12 

40 

13 8 

12 

28 

7 2 

13 


16 1 

13 

46 

8 1 

U 


22 6 

11 

18 

7 7 

16 


30 7 

15 


0 2 

10 


31 4 

16 

21 

23 1 

17 


38 6 

17 

16 

20 1 


Tablb III, —Comparison op Whitb Boys and Negro Boys from Sik to 
Seventeen in Marking Spbbd and Letter Making Speed 


White boys 

Negio hoys 

Ago 



Lcttcis 

Ago 

Number 

Mai lis 

Letters 

6 

38 

119 

51 

6 

10 

98 

45 

7 

36 

121 

74 

7 

21 

113 

71 

8 

19 

153 

123 

8 

25 

163 

84 

9 

27 


160 

0 

28 

169 

118 

10 

43 

196 

179 

10 

22 

107 

141 

11 

30 


191 

11 

21 


146 

12 

40 

223 

200 

12 

28 

21G 

100 

13 

32 

243 

228 

13 

28 

222 

183 

14 

44 

252 

234 

14 

10 

229 

197 

16 

34 


241 

15 

23 


20 ') 

16 

40 

271 

260 

18 

16 


234 

17 

49 

285 

268 

17 


248 

230 


The score was the number of lines completed in a five minute period 
The writer designed a mirror-drawing pattern to use m Grades I, II, 
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and 111 which included the figures from 1 to 15 The figures were 
so placed that the small children had no difficulty in locating them. 


Tabuo IV —CoMPAiiisoN OP Wni'PB Girls and Negro Girls prom Srx to 
Seventeen in Marking Sphbd and Letter Making 


White gills 

Negro girls 

Age 



Lcttcia 

Age 



Lottora 

0 

28 

112 

52 

0 

17 

102 

06 

7 

41 

147 

90 

7 

18 

136 

105 

8 

63 

104 

137 

8 

24 

161 

122 

9 

28 

103 

176 

0 

32 

175 

138 

10 

44 

212 

194 

10 

37 

202 

163 

11 

49 

217 

207 

11 


208 

160 

12 

49 

228 

227 

12 

28 

231 

199 

13 

37 

249 

260 

13 

45 

223 

206 

14 

57 

263 

208 

14 

18 

236 

230 

15 

01 

270 

272 

16 

30 

238 

231 

10 

48 

271 

274 

16 

24 

264 

250 

17 

49 

274 

280 

17 

15 

266 

251 


Table V —Norms for NBono Boys and Negro Girls in Mirror-dr a wing, 
Marking, and Letter Making 


Ncgio boya 

Negro girls 

Age 

Mirior- 
di'a\\ Ing 

Ma-ika 

Letters 

Ago 

Minor- 

drawing 

Marks 

Letters 

0 

1 7 

98 

46 

6 

1 

102 

65 

7 

2 S 

113 

71 

7 

4 9 

130 

106 

8 

8 2 

153 

84 

8 

3 7 

161 

122 

9 

6 8 

169 

118 

0 

■n 

176 

138 

10 

7 2 

167 

141 

10 

■M 

202 

163 

11 

9 7 

198 

146 

11 

6 3 

208 

166 

12 

8 8 

210 

160 

12 

7 2 

231 

199 

13 

8 2 

222 

183 

13 

8 1 

223 

206 

14 

16 2 

220 

197 

14 

7 7 

236 

230 

15 

10 S 

264 

200 

15 


238 

231 

16 

9 2 

203 

234 

16 

23 1 

204 

260 

17 

16 5 

248 

203 

17 


205 

261 


The two mirroi-drawing patterns weic evaluated on compai able groups 
m order to get continuoue norma through all ages fioin six to seventeen 
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The Tables I and III abow a coinpaiison of the ability of white and 
Negro boys from six to seventeen years of ngc in inirrow-driuving, and 
in making speed and letter making. Tabic II and IV show a compari¬ 
son of the same abilities between white and Kegio girls from six to 
seventeen years of age Table V shows the noima in miuor-drawing, 
marking speed, and speed m making letters for Negro boys and girls 
fiom six to seventeen 

Conclusions mow the SaMjsY 

1. Unselectod white high school pupils arc supeiior menially to 
unselected Negro high school pupils, a& shown by the tests 

2. In tho simple motoi process of maikmg, there is not much 
ilifieience between the whito and Negro chiUlien. 

3. In writing, which requires a greater degree of motor-sonsoiy 
coordination, the supenoiity of the white children la clearly shown. 

4. In the complex motor-sensory cooidiiiation process of mivrov- 
drawing, the white children are consistently supeiior to iho Negro 
children, 

5. The ability to do mirror-drawing incicases rather consistently 
from year to year with Negio children, as well as with wliito children. 



A STUDY IN REVERSING THE HANDEDNESS OE SOME 
LEET-HANDED WRITERS' 

NOBMA V SCHBIDEMANN 
Uinvoiaity of Southcin California 

AND 

HAZEL COLYER. 

Loa Angeles City Sclioola 

The subject of handedness has long been of interest to psycholo¬ 
gists, neurologists, eugemcists, and popular writeis, Reference to 
piofcasional liteiatuio will show that the classioom teacher of the 
primary grades, who has the best opportunity to observe hand piefer- 
enocs in non-established or poorly established activities, has taken no 
especial mteicst m the subject. The majouty of elemcntaiy teachers 
of a decade ago seemed to have a single rule in establishing writing 
handedness—all children must write with the right hand. Many 
left-handed adults tell us of exciutiating ordeals they wore required to 
undergo In trying to “break up" left-handed tendencies The 
majority of elementary teachers of today likewise seem to have a 
single rule in regard to establishing handedness in wuting—the light- 
handed child should write with his right hand and the left-handed 
child should be permitted to write with his left hand. 

That a child upon entering school, in his eagerness to do exactly 
the right thing, may be influenced by unimportant factors so that ho 
may show an unnatural hand preference foi writing movements is 
usually not recognized. A child’s lack of ciitical judgment is mani¬ 
fested constantly in his imitation of non-consequential factors in hopes 
of attaining significant traits or habits. Thus, a child may quite 
confidently try to smoke m Older to become manly like fathei, or 
try to walk pigeon-toed in order to bo like a greatly admiied friend 
Imitation of hand pieference for wiitmg may also be made by con- 


^ Tina atudy >vna made dming the accoad aomcatci of 1920-1930 la the second 
grade (IIB) of the Mehoao Avenue School, Loa Angolei Gifcy Schools. This 
aohool la located m a losidonUnl district of lEollywood The clnldicn aie noi- 
inal oluldicn and come Lorn much above nvemso homes 

Mis Oolyci, the sccoiitl grade tcachei of the gioup Btudicd, interviewed the 
paients of fclic oinUU'on and caiued out all tlie remedial piocedure in establishing 
a reveisal of handedness m anting 
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sciows imitaiion of an admucd playmate or tcachoi or by nnconBcious 
imitation when the child is anxiously trying to follow, in most minute 
detail, every movement of one demonstiatmg a desired Imbit or skill. 
That first grade children mi^y show unnatural hand piefercncos for 
writing and that the primary teacher may unwittingly mistake these 
unnatural preforencca for innate dominanw^, was lovealed m a recent 
study of n group of loft-handed writers ^ 

Of a second grade group of thirty-four children, sixteen wcio left- 
handed writers Both the fiist and the second grade teachers of the 
group weie left-handed; the childien^s wiitmg habits were established 
before they enteied the second grade. The impiobabihty of so high a 
percentage of left-handed childicn in an unsclcctcd group of normal 
individuals led to a study of these children in ordei to deteiminc, if 
possible, the native handedness of each left-handed wiitei and to effect 
a reversal of handedness in cases where that might seem wariantable. 

Since no single test has been devised whereby a child's native 
handedness can be definitely discovered, each child was given a soiies 
of tests, one for eyedness and nine for handedness Native eyedness 
is perhaps the best single indication of a child’s natively dominant 
side. Study of bodily asymmetry has resulted in the recognition of 
dominance of one side of the body over the other, that is, individuals 
are either dcxtroexperl, gencially, as to ear, eye, hand, and foot, or 
else they are siniafcroexpert * 

Hand- and foot-prefeiences are subject to training, but eye picfer- 
ence, except for accident or disease, lemains uninfluenced by cxpoii- 
ence. Hence the eye teat was considered the cntononal lest for native 
handedness, but it was nob consideiod justifiable to offccL a reversal 
of handedness on the basis of eyedness only Theio aie many degrees 
of native handedness, that is, some mdiYi<lual& aic strongly right- or 
left-handed; efforts to reverse their hand preferences aio of no avail 
and may even bo followed by unforfciinatD consequences Others 
are so mildly left- or light-handed that they change their preferences 
with the slightest training Mildly left-handed individuals, because 
they wish to conform to the majority and because most appliances 
are designed foi right-handed mdividiuils, usually picfci to tiain their 

* Sohoidemann, Norma V I A Study of tho Ilondctlno'is of Homo bcft-liamlpd 
Writois The Pedagogical Seminary and Journal of Genclic Psychology, Vol 
XXXVII, Dcq. 1930, pp 510-16 

2 Gould, G M “Bight-lmndcdnoas and Loft-liniuloducus ” Lijipincott, 
1908, pp 18-20 
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right hands. Children showing consistent right hand preference m a 
series of tests for handedness and left eye preference in tests for eyed- 
ness may well be permitted to establish right hand writing habits. 
About iwenby-thieo per cent of piesumably right-handed children 
have been found to be left-eyed ' In regard to left-handedness asso¬ 
ciated with right-eycdness Ballard* found that of fifty-one left-handed 
individuals fifty-seven per cent proved to be riglit-eycd, Qainan^ 
found fourteen such individuals in a group of twenty-eight. Parsons** 
found only four such cases among six bundled eight right-eyed 
ohildicn These findings made us cautions of hasty diagnosis. 

For this study seven of the eight tests used by Hacfncr® in dis¬ 
covering the composition of hand dominance of a gioup of children, 
and an additional test, wore selected ns bemg suitable for diacoveiing 
hand pieferencc Each lest was given thice tinaes, the hand used in 
two of the iiials was iccorded as the clnld’s preferred hand ® In 
summary the test used for handedness were as follows 

1 CuthnO —Tlie clnlcl was lequircd lo pick up a jiaii of scissors i)Iaced dueotly 
before him and to cut very caiefiilly along nn irregulai lino diawn upon a sheet of 
paper Tlio liand holding the ecibsors was recorded 

2 Winding. —A long co\d -waa fastened to n. jwivpii and placed diiectly bofoie 
the child IIo was then icciiuicd to wmd the coid about tho pencil. The hand 
doing tho wincluig wns recordecl 

3 Throwiyig —The child was lequucd to thiow a boft bnll to the Dxnminer 
Tho hand used to throw was rcroided 

4 Receiving. —The child was given a small object The himd with which tho 
object was received, was lecoidcd 

6 . Easy Reaching —The child wna leqimed lo leacli foi a hall placed ducefcly 
before him on a table The hand used was lecoided 

^ Mills, Lloyd Eyedness Mid Haudodness American, yournof o/ Ojihlhahnology, 
Vols I-IX, 1025, pp lGO-113 Iiithisstudyonclmndieclciglityleft-eyedchildrcn 
weie found among seven hundred cighty-foui piegumaloly ught-handed ohildien. 

Paisons, B S “Lofthandedness.” Maemdlnn, 1024 Paisons claims that 
about thnty per cent of all individuals are left-eyed and would bo left-handed 
weio it not for the operation of social piessnre 

^Ballaid, P B Smistialifey and Speech /otenud o/ilupeuaierUal Pedapogi/, 
Vol I, 1911-1912, p 298 

3 Quinnn, C : A Study of Sinistrality and Muscle Coordination in Muaicians, 
Iron-woikoia and Otlieis Archives of Neiuologjf and Psychialncs, Vol, VII, 1922, 
pp 352-300 

^Parsons Op cii, p. 107 

® Haefnor, IlalpU "TheEducationnlSigiuEicaiiGoof Lofl-haudeclno«s " Teach¬ 
ers College Conti ibutions to Education, No 300, 1929 

* This method of scoring was used by Uifo, J M Types of De'ctiality. Psy¬ 
chological Review, Vol. XXIX, 1922, pp. 474-480 
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6 EnergeUc Reaching —The child was rcquiicd to roach for a ball placed at a 
distance requiring an energetic reach. The hand used was recorded 

7. ThxmJ} Up —Each child was aekecl to fold hia hands by intcickaping h\g 
fingers The thumb that was placed on top was recorded 

8 BaUing —The child was required to liold a bat ready to strike a ball about 
to be pitched by the examincir The hand that was nonier the batting end of the 
bat was recorded. 

The test for eyednesa was as follows: 

9 Eyedness ,—A sheet of paper with a small hole torn in tlio center was placed 
in the ohild’s hands at about a foot or a foot and a half from bis face. A bib o! 
crumpled paper was placed upon the floor Tho child was directed to look through 
the holo at tho bit of crumpled paper Without permitting tho child to move tho 
Bheob of paper, tho examiner placed her hands nlternatcly over tho child’s left 
and right eyes The child reported whether or not ho was able to see tho bit of 
paper when one of hia eyes was covered Failure to see tho bit of paper, indicated 
that the dominant eye was covered 

These nine teats were given to the sixteen left-handed writers. 
The following table gives tho results of the tost findings. 


Hand- and ETB-pnBB'BnENCQs op Sdctbbn Lbft-handbd ’Wiutbiis of a Second 
Qradb Gnorjp qp Thiiity-foor Nohmal CuiLDnBM 


Teat 

1 

1 


Shirley 

1 

4 ) 

1 

1 

S 

1 

Roberta j 

1 

1 

1 

Ceefle 

1 

1 


Cutting . , . 

K 

L 

R 

h 

R 

R 

R 

R 

L 

L 

R 

L 

R 

a 

R 

R 

Winding 

R 

R 

R 

L 


L 

R 

L 

L 

L 

L 

L 

R 

a 

R 

R 

Throwing. ... 

K 
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L 

R 


R 

R 

R 

L 

L 

L 

L 

R 

R 

R 

R 

Becowmg 

R 

L 

R 

R 


R 

R. 

R 

L 

R 

L 

R 

R 

R 

R 

R 

Easy reaching 

R 

L 

R 

R 

R 

R 

R 

R 

L 

L 

L 

L 

R 

R 

R 

R 

Energetic reaching 

R 

L 

R 

o 


R 

R 

R 

L 

L 

L 

a 


R 


R 

Thumb up 

R 

L 

R 

R 


R 

R 

R 

L 

L 

R 

L 

R 

Q 


R 

Batting 

R 

R 

R 

B 

H 

R 

R 

R 

L 

L 

R 

L 

R 

B 


L 

Eyedness. 

R 

L 

L 

R 

R 

R 

R 

R 

L 

L 

R 

L 

R 

B 


L 




AcdOrdmg to the teat findings, we felt confident that ten of these 
sixteen left-handed writeis should be using their right hands for wiit- 
ing, namely: Ervin, Shirley, Marvin, Yvonne, Vera May, Richard, 
Melville, Oecile, Mary, and Anita. Carl and Jean, were, perhaps, 
very mildly'loft-handed and under other conditions would undoubtedly 
have established right-handed wntmg habits. 

Before any procedure to reverse the handedness of any child was 

begun, the second grade teacher called the mothers of the children 

\ 
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to the school individually The situation was evplained and the series 
of nine testa was given to the child in the mother’s presence so that 
the mother could see her child's hand prefeience in acts othei than 
wilting In all cases the mothers weie very much interested and m 
all but one case, were eager to cooperate m reversing the child's handed¬ 
ness in wiitmg. 

The particular methods employed in effecting a reversal of handed¬ 
ness were different for each child Some children needed scarcely 
more than an explanation and some entbusmsm over the early right- 
handed writing attempts. Other children rcquiied more encourage¬ 
ment, frequent reminding, and general procedures for training the 
right hand much like those given to beginning waters In many cases 
the first attempts with the right hand were better than the child's 
left-handed writing Most of these children were using their right 
hands easily and naturally within two oi three weeks, and all but one 
wore doing so at the end of the semester (after a period of six weeks). 
A few weeks after the opening of the fall semester, the teachers of the 
children whose handedness had been reversed wcie visited and ques¬ 
tioned m regard to the handedness of the children AH the children, 
but the one who had had difficulty in the spring semester, were using 
their right hands. 

During each conference with the mother and later during a ques¬ 
tioning of the child, an effort was made to determine the factors that 
might have influenced the child in using the left hand for writing. 
The immediate influences for left hand writing in the ten cases defi¬ 
nitely right-handed and the two cases who could use their right hands 
to advantage, seemed to be as follows: 


Influenced by left-handedness of 

First grade teacher . 1 

Mother , . , 1 

Playmates or class-mates ... 4 

Statement of second grade teacher 1 

Influence not known . 6 


It is of interest to note that in four cases the mothers did not know 
that their children weie writing with the left hands. The slight 
incidents that caused some to use their left hands is noteworthy 
Thus, when the second grade teacher remarked: " Wc seem to have an 
epidemic of left hands,” one boy decided he, too, would use his left 
hand "just to make one more.” Another child said she began to use 
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her left hand because her playmate broke her light arm and found it 
hard to use her left hand for willing. Tho child said she did not want 
“to be caught like that.” 

Although tho left-handedness of tlio first grade teacher was found 
to bo a direct influence in establishing but one case of left-handed 
■writing, still we may safely assume that indirectly the teacher’s 
left-handodness played a very impoitant rfilo in establishing left- 
handed writing habits among these children. A left-handed teacher, 
especially, if she had unhappy experiences or difficulty in tiying to 
establish right-handed wiitmg habits, is, perhaps, moic apt to permit 
a child to establish left-handed habits than is a right-handed teacher 
Left-handed teachers may be prejudiced toward having a child use 
hia left hand just as right-handed teachers may be prejudiced toward 
having a child use his right hand. 



THE SIGNIFICANCE OE A DIEEEKENCE BETWEEN 
"MATCHED” GROUPS 

B. F LINDQUIST 
State Univoiaity of Iowa 

A typo of cxpeiimentation viyy frequently employed in education 
and psychology is that which makes use of what are commonly known 
as “matched groups,” or as "matched control groups ” It is the 
purpose of this article to diaw attention to an Important error m statis¬ 
tical analyaia that has been almost universally characteristic of the 
reports of such, experiments, and to suggest an improved statistical 
procedure and discuss its possibilities 

In order to remove any possible ambiguity that may surround the 
term, "matched gioups," it may be well to begin with a specific illus¬ 
tration. Lot 118 considei an experiment to determine the rolativo 
effectiveneas of the "additive" and the "take-away" methods of teach¬ 
ing subtraction in third grade arithmetic The usual procedure in 
such an experiment would consist, briefly, of teaching one group of 
pupils by the "additive" method and another group by the "take¬ 
away" method and then of securing, after the period of instruction, a 
final measure of ability in subtraction for the pupils in both groups. 
The method then considered the better would be that under which the 
pupils showed the higher average final ability m subtraction 

In order that this pioceduro bo most valid, it is essential that all 
factors influencing the final measure, except the one factor under 
investigation—that of method, be kept as nearly as possible the same 
for both groups One of these factors most important to control is 
that of the initial ability of the pupils to profit by instruction. To 
control this factor, it is customary to "match” the two gioups with 
respect to some meuBure of initial ability Tina is done by so selecting 
the two groups that for each pupil in the fiiafc group theie exists a 
corresponding pupil m the second gioup identical with him with 
respect to this initial measure. In the case of this specific illustration, 
this initial mcnsiiie might have been the scoic on a general intelhgencG 
test, or the score on a suivey test in oi'ithmetio, or some other similar 
measure. If tho intelligence lest score had been used, the two gioups 
would have been so selected as to have identical distributions of 
intelligence test scoies—m other woids, they would have been 
"matched" on the basis of intelligence. 
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Kow it 18 a well known faot that, even though the two methods are 
equally effective m general (i e., for the entire population of Grade HI 
pupils), a difference in the average final scores of the two matched 
groups would almost invariably be found in a single experiment of this 
kind, Assuming equal "true” effectiveness, this would nevertheless 
occur because the experiment dealt with limited samples, and because 
differences due to chance m the selection of the samples would alone 
account for different perfoimanees on the final test in subtraction It 
is therefore the leaponsibility of the expciimenler, before drawing 
any general conclusions from a single obtained difference, to demon' 
strate objectively that the difference he obtained was larger than could 
reasonably be accounted for by chance, or sampling, errors. To do 
this he must know how large is the expected value of the difference 
that chance alone would account for in aa experiment of this kind. 
In other words, he must know the Probable Error of the Difference. 

In nearly all reports that have yet been made of expeiiments of 
this type, the formula that has been employed to determine the value 
of this probable enor has been the familiar foimula 

PE„ = a/pe?'+Te 7 a) 

in which the PE’s under the radical aio those of the respective means 
of the final scores for the two matched groups, each of which have 
been found through the use of the formula 

PEm-= 0745;^ (2) 

This Formula for the Piobable Enor of the Mean Is Not Valid for 
Use mih Matched Groups.’—It is based upon the assumption that the 
samples used are siricily random selections from the populations they 
represent This assumption is not applicable to matched groups. 
The process of matching on the basis of a measure which is correlated 
with the final measure destroys the randomness of the samples with 
respect to this final measure The probable amount of sampling error 
in the obtained diffeienoe, instead of being as largo as that indicated 
by the formulas given above, is usually considerably less, in some 
cases by more than fifty per cent. 

The reasonableness of these last two statements may bo made more 
clear by the following illustration, based in part upon the one previously 

’ Except la the very rtue case "whcie the mcnautes vised for matching show ao 
corrolfttion with the final measures 
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used. Suppose that a large number of eamplos, each of the same size, 
and each strictly random (not matched), were selected from the entire 
population of Grade III pupils. Suppose the pupils m each sample 
were taught undei identical conditions by the same method, and then 
measured by the final test m subtraction Variations in sampling 
would then result m a variation in the values of the mean scores of 
these samples on the final test. The standard deviation of these mean 
scores would bo the standard error of any one such mean and, m this 
case, since random sampling is specified, this standard error could bo 
validly measured by the usual formula for the standaid error of the 
mean. 

Now let us eonsidei a similar case, but one in which “matching” 
IS involved. If, in the first case (of landom sampling) an intelligence 
test had been given to the same samples, a variation would also have 
been found in the mean scores on the intelligence test, again due to 
sampling errors. Now since intcUigonco is correlated with scores 
on the subtraction, tost, a sample that due to chance showed a relatively 
high mean score on the intelligence test would also show a relatively 
high mean score in subtraction. If, therefore, a change were arbi¬ 
trarily made m that sample so os to bring the moan intelligence score 
down to the moan of all samples, the effect would bo to bring the mean 
subtraction score of that same sample nearer to the mean subtraction 
score of all samples than it was previously (in the case of random 
sampling). A restriction of the variation in mean mtelUgenco scores 
to zero (the effect of identical matching) therefore has the effect of 
decreasing the chance fluctuations in the mean subtraction scores 
In other words, the effect of matching is to reduce the value of the 
standard error of the mean subtraction score of a sample. The amount 
of this reduction would depend upon the dcgiec of relationship between 
intelligence scoies and subtraction scores. 

What 13 needed, therefore, is a new formula foi the standaid erroi 
of the mean of matched samples that takes into account this restrictive 
influence of matching upon chanco fluctuations in the mean. The 
type of reasoning alieady indicated led the author to suggest the 
problem of deriving such a formula to Mr Samuel S. Wilks, a graduate 
student in mathematical statislica at the State University of Iowa 
As a result the desned formula was obtained, and is as follows* 


O'M* = 


( 3 ) 



200 


The JouTn<d of Educalional Pstjchology 


m which (tu' represents the standard mor of means of matched groups. 
It will be noted that this formula differs from the usual formula only 
m that the right-hand member is multiplied by the radical a/ 
in which r is the Pearson product-moment coefiioiciit of correlation 
between the measures used as the basis for matching and the measures 
for which the mean is computed. In the case of the illustration, r is 
the correlation between intelligoncc lest scoics and Bubtraction 
SGOiea 

Since the original derivation of the formula by Mr Wilks, the 
author has devised a simplex foim of proof, which is reproduced here. 
This proof is not mathematically so iigid as that piovided by Mr. 
Wilks, but it will perhaps prove easier to understand for the reader 
not highly trained in matheraaticnl statistics.^ Por the sake of further 
simplification, this proof will be here set in terms of the specific 
situation already used m the pievious illustrations. 

Suppose that wo have, foi a veiy latge number of pupils selected 
at random from the Grade III population, the scores on an initial 
intelligence tost and the scores on a final subtraction test given after 
a couise of instruction by one of tho two methods described From 
this large group it would of couise bo possible to select a number of 
pupils all of whom made exactly the same score on the intelligence 
test These pupils would then be matched” on the basis of intolli- 
gence. It would then be posable to picdict, without direct calculation, 
the standard deviation of tho scoies of these selected pupils on tho 
subtraction test. This could be done through tho use of the familiar 
standard eiror of estimate formula 

ff,' = ff.Vl —( 4 ) 
in which cr^> represents the standard deviation of subtraction scores 
for the selected pupils, <t, reprosents the standard deviation of subtrac¬ 
tion scores for all pupils, and in which r„ ropicsents the coriclation 
between intelligence scores and subtraction scoies 

Now, instead of thinking of the scores of individual pupils, suppose 
that wc have, for a veiy large numbei of smnpZes, all of the same 
size and all selected strictly at random from the Grade III population, 
the mean scores on tho intelligence test and on the eubti action test. 
Again, as in the case of individual pupils, it would bo possible to select 
a number of samples all showing the same mean score in intelligence. 

* The original, and more rigid matliematioal derivation of Uio fonmila will be 
found m an articlo by Mr ’Wilks in this copy oE the JounNAn, 



Difference between “ilftricfted” Growps 


201 


These samples would then be “matched '* with respect to intelligence. 
Again It would be possible, through the use of the standard oiror of 
estimate formula, to predict for these selected fiaraplcs the standard 
deviation of mean subtraction scores This time, however, formula 
(4) becomes 

~ rV,M, (5) 


in which represents the standard deviation in the mean subtiaction 
scores of the selected (matched) samples, in which represents the 
standard deviation in mean subtraction scores for all samples, and in 
which represents the coeiHcient of correlation between mean 
scoies m intelligence and mean Bcsores in subtraction for all random 
samples 

Now the standard deviation in mean subtraction scores for all 
random samples is given by the usual formula for the standard error 
of a mean 



( 6 ) 


in which (Te lopresents the standard deviation in the subtraction 
scores of individual pupils in a sample, and in which 'N represents the 
number of pupils in the sample. 

The cocfRciont of correlation between the means of n senes of 
samples has been shown by Kelley^ to be equal to the cocfRcienb of 
correlation between the scores on which the means arc based Hence, 
m this case, 

ijov, “ 1M (7) 


in which r,# represents the correlation between intelligence test scores 
and subtraction scoies 

By substituting from (6) and (7) in (6) we secure the formula 


eu,‘ 


ffaV I — 

Vn 


( 8 ) 


which, by dropping the subsciipts peculiai to the illustration, becomes 
the formula already given as formula (3). 

Substituting the value of the standard erroi of the mean of matched 
groups as given by formula (.3) in the usual foimula for the standard 
error of a diffeience between means, we secuie the following as the 


^ Kelley, Truman L , "SUvtisUeal Motlmd " P 178, fonnuln (118) 
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correct formula to employ for detennining the standard error of a 
difference in obtained means for two raftfcched gioups 

tmt =■ ( 8 ) 

■where tri and as represent the standard deviations in final scoioa of the 
respecti-ve groups, whore Ni and iVa represent tlic mimbor of cases 
in each, and where i lepiesents the Pearson producL-monicnt coef¬ 
ficient of correlation between the measures used us the basis for matcli- 
ing and the mcasurOB between which the final comparison m means is 
made. 

It is obvious, from an inspection of formula (9), that the tuie 
standard oiror of an obtained difference between malchod groups 
might be considerably less than that yielded by tlic usual formulas, 
and that hence many differences which have been considered account¬ 
able for by sampling cnois might have been statistically significant. 
Fortunately, the mcoriecfe use of the formulas based on the assump¬ 
tion of random sampling resulted in errors only \u the direction of 
coDservativeness. That fact, however, is no valid excuse for their 
continued application, especially when the correct tecbniquc pioves 
so simple in application. 

It is important to note that fonnula (9) docs not depend upon the 
relation of the mean initial scorca of the matched groups to the “true'' 
initial score of the entire population which is being considered Per 
example, if the matched samples of the oiiginal illustration had due 
to chance been above or below the average of all Grade III 
children m intelligence, the formula would still apply This follows 
by analogy from the fact that the standard error of estimate fonnula 
applies to all values of the variable fiom which the estimates are made. 

The proof of formula (9) that is contained in this aiticle also 
suggests that the formula applies even though the exact distribution 
of initial scores is not the same for both matched groups, if only their 
wean initial scores are the same, This indicates that the formula 
should be valid for use with groups that have not been matched "pupil 
for pupil,” but in which the moans and standaid deviations alone have 
been equated. A moie rigid matliomatical proof of this pioposition, 
however, shouhl bo piovided before much confidence is placed in it. 

It is also important to note that formula (9) does not indicate 
how far the obtauied difference between two matched samples is 
likely to deviate from the diffeienco that would have been obtained 
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had the entire population been measured, but tells only how far the 
obtained difference is likely to deviate fiom the difierence that would 
have been found between mSnitely large groups showing the $ame 
disinhution of imhal measures as that matched samples that were used 
Where the purpose of experimentation, however, is simply to deter¬ 
mine (as IS usually the caso) whether thcie is or is not any leal differ¬ 
ence between the two methods of learning or teaching {i e., whether 
or not the obtained difference is statistically significant, and wheio 
the absolute amount of the difference for the entile population is not 
demanded) this latter caution is not of veiy great piactical impor¬ 
tance If, for example, a method is truly Biiperior for pupils at one 
level of intelligence, it is certainly likely to be superior foi pupils at: 
another level not far removed from tho first If icasonably largo 
samples are used (N > 30), and if the first sample is selected loughly 
at random fiom the entire population and the second matched wiih 
it (a usual procedure), it is not reasonable to suppose that the difference 
m intelligence between the matched gi'oups and the entire population 
(due to sampling ciror m the first sample selected) will be large enough 
to have any effect upon the validity of conclusions concerning the 
geneial relative effectiveness of the methods investigated 

It should haidly be necossaiy to point out that foinuila (3) is 
useful only to measure sampling fiuctuations fiom sample to sample 
in the means of samples that have been matched with respect to a 
related variable It in no sense, therefore, supplants the usual foi- 
mula for the standard error of a mean, since that formula is in no case 
valid in the specific situation to which foimiiln (3) applies. As far as 
most piaotical applications are concerned, formula (3) need not con¬ 
cern the investigator at all, formula (9) being the only one that need 
be directly applied in the usual ^‘matching” experiment In the case, 
however, wheie the effect of the methods compaiod is to result in 
diffeient values of the coriclation cocihcicnt between initial and final 
measures for tho two gioups, it is necessaiy to apply formula (3) 
independently to the mean of each sample, and then substitute the 
resulting values for the standaid errors of the means in the usual for¬ 
mula for the standard error of tho diffeienco lonnula (9) is given 
in oorabinaUon foim for the situation whcic any difference in method 
docs not SGiiousIy affect the conclation between initial and final 
scoies, which condition usually exists liven though the value of ? 
IS slightly different for the two gioups, formula (9) will still yield a 
useful and close approximation to the true standard eiior of the differ- 
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cnoe. It IS coDsidered desuable to propose formiila (B) in oombmatinn 
form smce it elimmatca the necessity of caleulalmg the standard error 
of each mean independently, and hence avoids the danger that iho 
less critical investigator will attempt to interpret these standard 

errors in the way in which the usual standard error of the mean 
interpreted. 



THE STANDARD ERROR OF THE MEANS OP 
‘‘MATCHED" SAMPLES 

SAMTJEI. S WILKS 
State Umveraity of 

Tlio problem of defeorminiiig the variation in the mean of one 
character of the items of a sample when the distiibution of another 
correlated charactei is made identical for all samples, item by item, 
with an aibitraiy distribution, was suggested to me by Piof. E P 
Lindquist of the State University of Iowa A discussion of the use 
and importaneo of the thcoiy as a statistical technique in ceitain 
types of experimental work will be found in an article by Lindquist 
in this issue of the Journal In this papci I shall consider only the 
mathematical derivation of the cxpicssion for this vaiiation. 

In ordci to stato the pioblcm more acemately, we may desciibe 
the typo of sampling mvolvcd m the following manner. Suppose a 
sample of N items la diawn from a population m such a way that the 
distiihution of a particulai character X of each item is made identical, 
item for item, with a given X-distiibution. This selection oi matching 
of X'h is made at random lolative lo a second character 7 and the only 
case of genoial intciesl is that in which there is a couolation between 
X and 7 The quoation natmally auscs: What is llie expected varia¬ 
tion in the moan^ of Llio 7’s duo to such sampling? It should bo noted 
that the given distiibution of X may be of an arbitiarily selected form 
or it may be dnived at random The results, ns we shall see, are 
independent of the form of this distiibution 

Let US assume that X and 7 nio noiinally distiibufccd, and that a 
con elation of r exists between them As was previously stated, we 
can obtain moio general lesults at once without making this assump¬ 
tion of normality, but it is the first one made because of the gieatei 
practical interest in the case of a normal distribution For con¬ 
venience, let us think of the X-7 plane as being divided into small 
squaies Then in any finite sample of N items there are only a finite 
number of squares into >Yliich the points (a:, y) {each ropresenting an 
item of the sample) will fall. Tlio distribution of 7^a associated with 
a given value of x which is taken as the mid-point of the p-th intei- 

^ I have obtained cxpicssfona for tho varmtion in the a fcandard deviation of 7 
and in tlio conelation coeflicicnl; r between X and Y, but have not included these 
in this articlo. They will be made availnblo later in my Doctor's thesis 
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val of X’6 is callGcl the a-p array of Y’a. Similarly y, is the midpoint 
of the -i-th interval of F's. Of the N pairs of X and F, ?ij, will have 
the value of the X charaotei in the interval Xp which foim the Xp array 
of F’s. This array will have its mean and its atiindard deviation, 
which we will denote by and tfj, icspectively. The mean of all Y 
characters will be y and their variability will bo given by cj. The 
number of the N items falling into the square with center (xp, j/,) will 
be denoted by ttpi. 

Let 6 denote the sampling deviation of a variate from i ts true value. 
Then since the distribution of X’s is constant from sample to sample, 
it follows that tho deviation Sup is aero. Wc shall make uso of the 
propositions that if s and a' arc the frequencies in any two mutually 
exclusive non-independent (when either or both are subjected to 
landom sampling variation) frequency classes of a frequency dis¬ 
tribution of M elements tho standnid deviation of s duo to landom 
sampling is given by 

S(5.«) = (1) 

and the correlation between deviations in s and n' duo to random 
sampling is given by 

S(S 5 65') = (2)^ 

Now it ia obvious that wc may write 

Ny == Sp\S,inptyi)] (3) 

where the sums are taken over all values of p and i. 

Taking the variation we have 

NSy = iSp[tS,(BTipjj/,)] (4) 

squaring 

- 4 - SpASJSnp,y,)S,(S7ip>jyp)] (5) 

where Spp' denotes the summation over all values of p and p' except 
for p = p'. 

Expanding again, 

N\hyy = 4- 

+ Spp\S,{Snpt^npi,i/y)] -f ^pA^Mi^ihMp^jUxy,)] (6) 

where the moaning of is obvious. 


1 For proof, SCO KioU, E L ; "MathomaUcal Statiatice1927, p 119, 
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Summing and dividing by the number of possible samples of this 
kind, and using the pioposition that the expected value of a sum is 
equal to tho sum of the expected values, we get 

NW = Sp[S,(jEidnp,^)y^^)] + Sp[S„{]S{dnj„5npj)yijj,)] 

“h *Spp'[>S,(^/(5?ip,5np't)2/i®)] -f- Sppi[St}{Iii{5np^5np'j)yiyj'j], (7) 
But from (1) it is evident that 




and by (2) 


SAS.,{mnpMp,)y,yj)] = -Sp 


tfiV, 


(9) 


Let us consider the expression B(finp,6np«,) for p different from p' 
Since Up is invariable from sample to sample, it follows that the devia¬ 
tion Slip, for any i within the group tip cannot affect the deviation 
3np which is zeio and therefore cimiiot affect the deviation of the 
sub-group Up't in any other group np> for p different from. p'. Hence 
the deviations Snp,. and are independent for all values of p and 
p' provided p is different from p* 

Hence 

B(5np{&np>j) = [.ff(5np0 • M(Bnp'i)]. (10) 


Thus the last two sets of terms of (7) vanish, and combining (8) 
and (9) and placing this value m (7), we get 

-.rn * rt [ r r. / hNT 

NW = Spj[;Sf.(np,yf®)]- - - 



« Sp[S,(npij/,*) — np^p®] 

= 8p[St{np.{y. - ypm 

(11) 

But 

jSiE'np,(3/i 1/p)*] “ 'n'ptfp® 


hence 

NW = Sp[npffp*] 

(12) 


Since we haVe assumed normal distubution, and thus a homo- 
scedasUc system with linear regi'casion, all airays of Y’b have the same 
standard deviation o-y-v/l “ r*. 

Then 


Spinpffp^] = Nsy^ « 
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ViV 


( 13 ) 


which we note again is independent of the distribution of I m the 
sample, It must not be construed, however, that the expooted value 
of the mean of the Y s is independent of the distribution of the I’, 
I state, without giving proof heie, that the cxpoctod value of i] is given 

= j,„) 

where and y, are the tiue moans of the Ts and F’s for the entire 
population and a is the moan of the given dislnbution of X's 
By similar methods it is not diflioult to sliow that if all of the 
Items of a sample aie seloolcd or matched on s - 1 chiiraetors, where 
s charaotors are normally distributed and not iiidopcndent, and with 

linear multiple regression, then the standard eiior of the means of the 
character Xs ig given by ® 

Vn . ( 15 ) 

whoryvi, , ,s the miiUipIc coirnlalion oocdiciont of oidcr s 
- 1 of X, with the s - 1 vmiables 

It may bo of interest to know that all of the re,suits contained m 
this paper have been confirmed independently through the application 
of an entirdy different niid somewhat inoie rigorous motliod pioof 



RELIABILITY OP INTEGRATION INDEX 
DIFFERENCES 

JOHN W DICKEY 


Stato Noimal School, Kcwaik, N J 

The formula 



a 


( 1 ) 


has been picsentccl/ by the writoi, as a quantitative measuie of pupil 
integration within the public schools The formula giving the relia¬ 
bility for separate inclicca has also been reported ^ 

The necessary compaiison of indices (whether made by the same 
population on different tests or on different forms of the same test, or 
made by uncorrclatcd populations on chffei-ent tests or the same test) 
18 statistically iraposaiblo without the use of formulas which yield the 
reliability of their differences. 

It 18 the purpose of this paper to clonvo the standard error and the 
probable erior formulas which arc nccessaiy m the comparison of 
indices for both the correlated and the imcoivclated gioups 
Let, 

A[\ = mean gi 083 actac on teat one 
il/, B moan gco»s acoio on test two 
<Ti a standoid deviation of gross aeoiCH on test one 
<rj B standuid deviation of gioss scoies on tost two 
rn = correlation between test one and tost two 
N = the population 

- = Integtotion Index on tei»t ono 

O'! 

Ki = ^ - Integration Index on test two 

A, = Ki ~ Ki ~ an index diffcionco 


The standard deviation of such index differences, as 

^ ^ U2 _ ^ 

ffi 

is the loquirod formula 


( 2 ) 


^ An Index of Intogiation. Journal 0/ Bdiicalional Psychology, Vol XX, No 9, 
Dec, 1929, p 625 

* Note on tlie llolmbility ot tho Indo\ of Integration J owi nil of Edacaiwnal 
Psychology, Vol XXI, No 3, March, 1030, p 231 
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By writing the total derivative of equation (2), we obtain the 
differcntifil equation 

,, aidMi- M%d<xi . Midai — cexdMi 

-(3) 

When squaring, summing and dividing by the Iheorctioal infinite 
population, we got the variance of A in the foim 

„ 4- — 0 , 4- — 0 

' '' 

, M,w, 4 0 4 0\ . . 

\ ^ ^ 


The zeros in equation (4) occur bocau&o the correlation between 
the two independent variables, M and a, is aero. 

The following simplified formulas arc tho result wlien wc substitute^ 


tr* u* 

rb 2 , trV *=* cK =s and H 


M 
- ’> 
0 


in equation (4) and reduce to a convoment form. 

o-i* = ^(4 + /fi» +i£:,= - f.taCAr,, + 2)1 

whence 

o'(x,-jr,) *= 4 4 ■K'l* 4 — ris(/Ci/C2ris 4 2) (5) 

and 

( 0 ) 

In case the reliability of index differences (which occur when 
different forms of the same test arc used) is to bo subatantiated, the 
correlation coefficient is at onco tho reliability coefficient of tho test. 

If the reliability of index diffeicncea (for uncorrolatcd groups) is 
to be investigated, formulas (5) and (6) reduce immediately to tho 
formulas 





I /2 + KJ . 2 + IW 
V2\ JVi 


(7) 


* Kelleyj T, L,; "StatiBtioal MotlTOil.” No\7 York Tho Maomillan Company, 
1Q23, p. 17&, foimulfts 118 and 121. Tlio ftBaviniptions, m tho case of T^g ~ 
of leotiUnoanty, homosoodastnaty, and oqiial kiirtosis, do not vitmto onr findmga 
ftince a variation of forty points in tho coriolntion cocfiiciont is icqinrcd to oroato 
aiound a Ion par cent error m formulas (6) and (6). 
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and 




( 8 ) 


where aad Ni are the respective populations, 

formulas (5) and (6) are used when indices are compared for any 
given population; whereas, formuioa (7) and (8) are used when indices 
are compared for entirely different populations. 



PARENTAL AGE AND INTELLIGENCE OE OEESPRING 

MINNIE LOUISE STECKEL 
University of Chicago 


Tho objccl, of tbs study was to cUadoso, if poaaiblc, any rclationahip 
which might exist between tho mtcUigcnce of chilcU'en and parental 
ages at the timo of the birth of tho child on tho basis of findings on a 
large population by the use of intelligence tesla 

The data upon which this study la based woio obtained from 
public school children ab Sioux City, Iowa and tlieir parents during 
the school years 1926-1928. The study includes records of children 
from Grade I to Giado XII inclusive Intclhgciice ratings of the 
children weie obtained by means of group intelligenco teats. Ques- 
tionnaiies wore sent to the parents asking for tlieir own ages, and 
the agea and birth older of all llicir childien. 

Four different group tests wcie used in Older adequately to cover 
tho ago range of intolligoncc Tho Kuhlmann-Andoreon Test was 
used for grades I to Junior III; the National Intelligence Test for 
grades Sonioi III to vSonior IV, tho Ofcia Intermediate Test for giadcs 
Junior V to Senior VIII, and the Otis Advanced Tost for grades 
Junior IX to Senior XII. Several thousand children wore tested with 
each test It was possible, ihercfoic, to rcstandardize on tho same 
basis the intolUgonco quotients as obtained by each of the four tests, 
80 that tho resulla of all four teals arc directly comparable. The 
standard scoic is calculated in the following manner 


S 


(IQ) - M 


111 which S is the standard scoie, M is the mean intelli¬ 


gence quotient for the year gioup of the chiUVs age and a is tho standard 
deviation of the intelligence quotients for that ago group By uamg 
the intelligence quotient upon which to base the calculations rather 
than the raw score, the measure is uncoriclated with age By trans¬ 
muting the intelUgence quotients of each test into standard acoies the 
possibility of differences which might arise due to tho relative difTioulty 
of the tests at tho various ago levels is eliminated The constant 5 00 
has been addod to tho standaid ecorca aa oalculaled in ordci to avoid 
negative values. Thus a child whose rating is 6 00 has an intelligence 
rating equal to tho average of all children of Sioux City of his age. A 
child with a score of 3.80 has a standard acoic of ~ 1.20 foi children of 
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his own ftge group. Only records of normal children of the Caucasian 
race are included in this study. 

Some parents may have stated their own ages inconecUy There 
was, however, nothing coinpulaoiy about answering the questionnaire, 
therefore these cases would be so few comparatively that they would 
scarcely affect the validity of tlio study. In Table I columns C and 
D show the distribution and mean intolhgonce of the children foi 
each two year age poi lod of the parents Figure 1 presents graphically 



/HatftTTral 


Vw 1. 


the relationship between the mean intelligence of children born during 
each two year age period of the mothers Curve C shows this 
relationship for the first-born ohildien, and Curve D for all children 
regardless of birth-order. Both curves indicate that children born 
of motheiB who are less than approximately twenty-six to twenty-eight 
years of age are, in general, less intelligent than children boin of 
mothers who are this age or older. 

Curves A and B of Fig. 2 shows a similar relationship between 
intelligence of children and paternal ages. The chief difference is 
in the fact that the curves representing intelligence of children and 
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paternal ages indicate that children born of fathers under approxi¬ 
mately thuty 01 thirty-two yoais of ago aro in gciicial less intelligent 
than children born at this paternal age or older, whereas (as has been 
said) this period with lespect to maternal agos extends approximately 
only to the twfinty-sUth to twenty-eighth year. 

C Although the ourves indicate pcuocls of very high intelligence 
after twenty-eight and thnty-two yeais for the malornal and paternal 
ages respectively, those cases aro at the oxtrome of tho curve and are 
represented by a relatively small number of cases. In general, after 
these age periods, thero is a slight drop in the curves representing 
'ohildreu’a mtelligenco. 



The curves C and A representing mtelligenco of first-bom children 
and parental ages are consistently higher than curves D and B repre¬ 
senting the intelligence of all children regardless of biith-order. 

These facta as presented might have several possible inteipretnr 
tions, It may be conjectured that whatever causes tho vitality of 
the human body to incieoso as maturity is approached and to diminish 
with advancing ago may also affect the uniting roprodiictivo cells and 
have a deleterious effect upon tho mentality of tho offspring Anotlier 
possible interpretation may bo that tho extiaordinaiy somatic diffi¬ 
culties accompanying child birth m immature and m elderly mothers 
might produce so great initial handicaps upon then children that 
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they may never be fully compensated by the time the children 
reach maturity 

It might be that tho diffeicnccs in enyironmontal factors for chil¬ 
dren of very young or elderly parents as coinpaied to those parents 
of the intervening age period are pionouncod enough to affect to an 
apprccmblo degico the lating of children on an intelligence test given 
at school. 

Possibly the explanation of the results of this study is to be found 
largely on a nationality and socio-economic basis. Grouping parents 
according to ago necessarily involves nationality, and socio-economic 
groupings also. Although the data are limited to the Caueasmn 
race, either one or both of approximately one-fourth of the parents of 
the children are foreign-born. These are largely of Russian, Lithuan¬ 
ian, and German extraction. There is a tendency for European stock 
to marry young. It also ib probable that children of immigrants, 
on the whole, would i ate a little lower oji an intelligence t est than would 
children of native-born parents. 

The army examinations showed that the various occupational 
groups draw men of different mtclligcnce levels. These occupational 
groups, tlierefoie, constitute social classes based on intelligence 
Studies by Hirsh,^ Kornhauscr,* and Haggerty and Nash,® show 
that the occupation of the father also is a fair index of the intelligence 
of his children, t.e., that there is a very real association between 
parental occupation and intelligence of offspring. 

Children of very young paients aio children of parents whose 
occupational choice does not demand college or professional tiaining. 
Many of these parents do not even go to high school. They drop 
out of school as soon ns attendance laws permit or as soon as labor 
laws peimit them to work. Not that going to college on the pait of 
the parents appreciably increases the intelligence of their offspring 
but the parents in occupations which do not demand a long period 
of training are of a stratum of society which, hvea on a lowei economic 
basis. The more intelligent children are offspring of parents who 
have gone to college and professional schools. These parents of 

^ A Study of Natio-raoial Mental Differencoa. Oenelxc Psychology MonogravK 
1020, pp. 230-407 

*Tho Economic Standing of Parents and tho Intelligence of Tlieir Children 
JournuUSilucalionalPsychology^YiA LX, 1018 

* Mental Capacity of Children and Parental Occupation Journal Educational 
Psychology, 1924, pp 660-672 
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necessity many later. Tlieir cliildien are not more intclligoni because 
the parents are older and possibly not because their parents have 
bad more education but rather because Iheir parents como from a 
higher, moro intellectual stratum of sooicty The scale of living of 
this stratum of society demands that mainago nnd rcpioduction be 
delayed until the parents arc economically able to maintain their 
family on a scale of living to which they themselves liave been 
accustomed. 

The explanation of the fact that the intclhgence of the child cor¬ 
relates as closely with the father's age as willi the inothci’s age (except 
that the period of gieafccst mteUigence for the child comes tliiee or 
four yeais Inter for the father's age) might also be explained on a 
socio-economic basis rather than on a beiedilary or biological basis 
accounted for in the fact of the later maturing of the male parent. 
The demand made on the father in support of his family delays his 
marriage and his reproductive period several years latoi than the 
mother's in order that ho may first establish himself economically 
and socially. That there is the same relationship Iiotweon intelligence 
of children and paternal ages as between Intolligence of children 
and matevnal ages might be explained in the fact that the paternal 
ages correlate positively with the maternal agea and llicreforo bear 
a similar lolationahip to the intelligence of theu offspring. 

The seemingly greater intelligence of first-born childicn, as indi¬ 
cated by tho highoi curves A and C, undoubtedly has its explanation 
on a socio-economic basis. It is generally understood that the lower 
economic classes have larger families than do tl\e professional classes. 
Tho children coming from the lower occupational gioups also have 
lower intelligence ratings As long as wo consider only tho intelli¬ 
gence of the first-born obildron, each family la rDproacntccl only once. 
The superior intelligence of tho children of tho profossional classes 
raises the intelligence level of the entue group. In curves B and D, 
representing the intelligence of all children against parental ago, the 
relatively lower intelligence of the greater number of childicn from 
families of lower socio-economic groups lowers tho mean intelligence 
of the entire group. Tho greater mioUigcncc of childien represented 
in curves A and C is to be explained, then, not in the fact that they 
are first-born children but in tho fact that caoh family of tho lower 
occupational classes lias no more lopresentativcs in the group than 
each family of the professional cloases. 
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If late maniago and reproduction accompany a rising economic 
status, then the children of elderly parents should exceed the children 
of middle-aged parents m mtelUgcnee A. slight chop of the mtelli- 
gonce curve of ohildicn of eldcily parents might conceivably be due 
to biological factoi a such as poor productive stock with a low fecundity- 
fertility ratio or to tho physical decline of the older parent, The 
seemingly lower intelligence of chiklien of this group, as indicated by 
the lesults of this study, might also find its iiitorpretation on a socio¬ 
economic basis; for not only do parents of iho lower economic classes 
icproduco at an earlier ago than do the professional classes but there 
js a tendency for child-bearing to he continued throughout the entiio 
reproductive peiiod of the mother of the laboring classes while for 
tho professional classes child bcaiing is ristiictcd toward the close of 
the lepioductivc poiiod as well ns at its beginning. A slight decrease 
in intelligence of children of elderly parents^ as indicated in the study, 
might bo accounted foi m the fact that this part of the curve again 
ropicsents a piepondorancc of children from the lower occtipational 
groups. Undoubtedly this diop in the curve of intelligence would 
be more pionounccd weie it not for the fact that within the same 
family intelligence increases with ordinal number as shown in an earlier 
study ^ 

The relationship between parental ages and inielhgence of their 
children as indicated by the results of this study is doubtless a true 
relationship. Tho conclusion that ilp.ere is a diiect causal lelation- 
ship between parental ages and the intelligence of their childien is 
not at all justified liy the lesuUs of the presont study. Tho writer 
makes no claim to having established the cause or causes underlying 
the lesults of the study 

If the population in question were first classified into occupational 
groups and the age of patents and intelligence of children compared, 
any differentiation might indicate biological factors operating which 
are dependent upon parental ago, Piesent indications are that in 
such occupational groups the vaiiation in intelligence of the childien 
would be no gieatci than the occupational variation of the baienia 
within each group 

A subject closely associated with parental age and intelhgGnoo 
of offspring is amount of disparity betwoen the ages of tho two parents 
as compared to the inielhgence of thcii offspring Custom and general 

‘Steckcl, Minmc Louise: iDtolligonco and Birth Order in Family Journal 
of Social Psychology^ August, IQ30 
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Parental Age and InteUtgence of O^spnng 

opinion piesuma-bly would favor the father being fiom two to five 
years oldei than the mother. In Table I, columns E and F give the 
distribution and mean intelligence of the children for each two years 
disparity between the ages of the two parents. This lelationship is 
shown graphically in Eig. 3 Curve E icpiesents the mean intelligence 
of first-born children and curve E represents the mtelligenee of all 
children against the disparity between parental ages The disparity 
between the ages of the two paicnts is indicated by the '‘Fathers’ age 
Minus the Mother’s ago.” When the fafclier is the older paient the 
difference between the ages is indicated as +, when the mother is 



older the difference la indicated as —; and 0, of course, indicates that 
both parents aie of the same age. Considering both curves E and 
F, the mean intelligence of the childicn dcci eases as the disparity 
between the parental ages mcreasea. The curves both show a more 
rapid decrease m the intelligence of the children when the mother 
is the older parent than when the father is older At the extremes, 
in both -f- and — directions, the cases are so few that the curve is 
very irregular However, the general tendency downward, indicating 
lower intelligence, is quite appaient. The curve of intelligence of 
the first-born children against disparity of parental age is higher 
than when the intelligence of all children is represented. Heie again, 
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as with parental age and intelligence, the lavgci faniikcs having more 
xepresontatives and lowoi intelligence latings, lower the mean intelli- 
gence of the entire group. Wlieu the mean mielhgonce of only the 
iirsL-boi'n children is conaideicd, the fatnilios of the professional 
classes have equal repjeaontation with the lower occupational groups, 
so the mean intelligence of the gioiip ib higlior 

The writer knows of no study indicating whother gicatcr disparity 
between parental ages is move common betwoon foicign born parents 
or between natlve-born-paiorris, between parents of the professional 
classes or between pnronlg of the lower socio-economic groups, or in 
whicli gioups the mother inoic often la the older. Such evidence nncl 
an oacupational classification is necossaiy bcfoi'c the causes which 
are operative to produce the lolationship betweon iiitclhgence of 
ohikl and amount of dispaiity between parental ages can be deter mined. 

The results of this part of the study indicate that the grcaipr the 
disparity between parental ages the less favoiablc is the piognosis 
for the intelligoaco of the offspiing 'Fhc prognosis, however, is more 
favorable if the fathci is the older paient than if the mother la the older 
paient if the amount of disparity between the ages of the two parents 
la greater than four or five years 

Conclusions 

In general, as shown by intelligence tests, children born of very 
young parents are less mtelligonl than children born of more mature 
paients Below the ago of twenty-six to twenty-eight for mothers 
and thirty to thirty-two years for fathers, the younger tho parents 
the less favoiable la the piognosis for tho intelligence of the offspring. 
The present study indicates that the nearer tho ages of tho two 
parents approach each other the more favorable is the prognosis for 
the intelligence of their childien. The prognosis for tho intelligence 
of the children is less favorable as tho disparity betweon paiental 
ages grows oxtreme When extreme disparity exists between paiontfll 
ages the prognosis foi the intelligence of the child is better if the father 
18 the older parent than if the mother is the older parent 

The writer presents BOYcrol possible interpretations of the icsuUs 
of the study but makes no claim to having established the factors 
which might be operative in pioducing the resultB as presented. Fui- 
ther study must be made to reveal which interpretation most nearly 
approaches the truth. 



SEX DIFFERENCES- COLLECTING INTERESTS 

PAUL A. WITTY 
Northweatern Umvoreity 
' AND 

HARVEY C. LEHMAN 
Ohio Umvoraity 

In a previous article the wiitcrs have questioned the instinctivenesa 
of the collecting tendency.* They have mentioned also some of the 
difhcultiGB that one encounters when he attempts to define the term 
'^collecting.” Definition of "colleotmg” appears to be varied and 
inconsistent; it is nevertheless true that studies of the articles which 
children report that they actively collect may reveal certain intrinsic 
interests of children. Therefore, it seems logical that such interests 
might be used profitably in motivating school work. Collecting inter¬ 
ests appear to be associated intimately with the growing self; the recog¬ 
nized identity of the interest and the giowing self (with consequent 
inner urge) should piovide a genuine actuator of interest and conse¬ 
quent success in school work. Of course, numerous interests are 
undesirable; these should be recognized, sublimated, and redirected. 
Others, howevei, seem salutary manifestations of growth These 
should have abundant opportunity for expiession in the curricular 
activities Genetic studies of behavior manifestations seem to the 
wiiteis to bo of inestimable value in guiding and developing school 
children 

In a piGvious article,* the wntets presented a list of approximately 
200 articles which children hated as ones they were actively collecting 
in 1927-1928 Further analysis of these data has yielded certain indi¬ 
cations of sex differences in collecting interests which appear to be 
significant 

As a means of studying tlie sex differences in collecting interests, 
the writers listed the articles* that were collected more than twice as 
commonly by boys as by girls, they listed also the articles that were 
collected moie than twice as frequently by girls as by boys By this 

* These data wore assembled by one of the wiiters and several graclunto stu¬ 
dents The table containing thoaiticlcsmoBtficquontly collected, and themetliod 
of investigation may be obtained by reference to this Journal, Vol XXI, 1930, 
pp 112-128 
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raoans two lists wove obtained. The first list therefore includcB only 
those collections -which seem to appeal picdominanily to girls; the sec¬ 
ond list includes only those collections which appeal strongly to boys. 

The articles which are collected much more frequently by girls 
than by boys appear m Table I, those which have a much moie intense 
appeal to boys than to girls arc listed in Table II. 

In Table I, the articles collcoted by the girls are classified under 
seven headings, namely: (a) Objects possessing icsthetic appeal or 
value, (6) objects for poiaonal adornment, (c) objects of sentimental 
appeal, (d) dolls, doll clothes, etc, (c) household accoutvemonts, (/) 
Bouvenus (piedominantly from the classroom), and ((/) objects used 
in playing games. In Table II, the articles of unusual interest to the 
boys are assembled under six headings, namely; (a) Animal parts and 
insects, (6) junk (to sell), (c) tobacco souvenii’B, (d) objects assooialed 
with war, hunting, fishing, otc, (e) objects used m playing games, and 
(f) miscellaneous ones. 

In examining Tables I and II certain facts should bo kept m mind. 
In the first place one should recall that this presentation seeks to place 
m sharp relief sea; differe>ices, not sex likenesses. If this fact bo oycn 
looked, the render might exaggorato tho significance of tho sex 
differences. For example, m Table I (a), tho girls arc shown to have 
collected mote often than tho boys objects of icathetic appeal or value. 
Neveitheless, one or moie boys collected all but one of tho items listed 
in part (a) of Table I. The items listed m Table I (a) aio not ai bides 
collected only by gills; they me items which wero collected more than 
twice as frequently by girls as by boys.'” 

One must bear m mind also that these data were obtained within a 
rather restricted geographical area. A specific environmental back¬ 
ground is therefore reflected. For example, in Table II (a) it will bo 
found that the boys collected furs, rabbits’ cais, gopher skins, etc It 
IS clear that city boys’ collections would yield no such colleotious. For 
this reason the sex differoncea Iiercin repoited should bo interpreted 
with the realization that they obtain for a specific locality only 
Nevertheless, when these data are viewed fiom the standpoint of tho 
several groupings rather than from tho standpoint of specific items, it 
seems probable that the box diffcicnccs may bo representative of 
widespread and rather general tendencies. 

* TKq writers have proviously diBeuescd the tact of sex ihffereucca m ccathctio 
appreciation. (Sgq ^uienccn Jovmal of Petfcftoiool/, Vol XL, July, 1028, pp 
449“467.) The pieaent findings corroboiato tho coivcluaiona sot forth previously. 
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Table I —Items Muon More Often Gollbcted by Giuls than dy Boys 


SOS girle, 80S boya, 

POT cent pOT cent 


(а) ObjoolB poeaceaing ccatholio value or appeal, 

Ferna 

Flowcta, pressed . 

Flowora, pnpor 
Grasa (kinds o(] . 

Loaves (kinds of) 

MonograiTie 
Moss (kinds of) 
paper, eolorod 

Taper, kieeuo . . 

Fioluros I 
Foems (Qolloofcod) 

Iloao petals 
Reeks (Wnda of) 

Samples (perfume, oto ) 

Fieeea of enlioo 
Hsndkorahlefa . 

Soohet bags 

( б ) Ob^Oflt^ (or personal adornmont 

Braccloti 

Bronstpioi 

Bar rings ,, 

Jewelry ... 

Xnoe , • • ■ 

Hatpins , 

Scarf pins , , , 

Stick pins . , 

HInga < 

(g) Objeota wlikh poeeoaa eontlmeQlel value 
Autograplis 

Auiogtapb sentimonU , 

Song oooke (kinda of) 

Cariia (olcolion, merit) 

Letters 

KawBpnpor aornpB 

Programs (daticoi oto ) • 

Souvenirs . . 

Yolontinca 

Cliarm atringa 

Clover, four-leof 

(d) Dolls And doll parnpbropatia 
Dolia, ,1 • • 

Dolla of paper 
Doll buggies 
Doll rlotnca . . 

Doll dishes 
DoH hots I 
Doll quilts 

e) Household nocoutrementa 
China (paintedi 
Dishes (btokea) 

Napkins ■ 

Pieces of quilts. 

Spoons. . 

Thread , 

, Btiinga 
Calondara 
Shoes (old ones) 

(/) Souvenirs from the schoolroom 
Schoolbooks .. 

Compositions ,, 

Drawiiiga 

(0) Oblceta used In playing games 
JAckstoncB > > 


1 

11 

7 

1 ; 

14 

1 ■ 

3 

8 

4 

20 

15 
4 
9 

14 

3 

16 
3 

12 

7 

8 
7 

18 

9 
1 
1 
1 

10 

17 

14 

0 

0 

14 

7 

8 

12 

28 

3 

13 

11 

14 

3 
12 

8 

0 

8 

4 
4. 
7 
4 
4 
4 
4 
7 

2 

12 

4 

13 


2 

4 

2 

0 0 

4 

0 6 
1 
3 
1 

5 
0 
2 
E 
0 
1 
5 
0 

3 
1 
I 
1 

4 
I 
0 
0 
0 
3 


5 

8 

3 



3 

3 
7 

11 

1 

7 

1 

1 

0 

0 

0 

0 

0 

2 

1 

2 

1 

1 

1 

2 

4 
1 

0 

1 

7 

2 
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Taule} II —Items Much Mores Often Collected hy Hoys than dy Girls 



HOfi boys, 



per cent 

per cent’ 

(a) Animal Rnrta nnd inacala 



Beetles 

3 

1 

Snnils 

2 

1 

Spiders • 

2 

0 

Birda cg^a 

A 

2 

Birds benks nnd clnne 

1 

0 

Birds winga • 


0 

Puts 

H 

2 

Gonlinr akina 

Itablnt cars < 

I 

7 

0 

1 

Skclotons • 

1 1 

0 5 

Skins 

t 

0 

(b) Junk to sell (At Icnst anlnblc) 


Bouts 

:i 

1 1 

Bottles 

0 

i 

Brnss 

5 

1 

Iron 

7 

I 

Jugs 

A 

1 

TTorse sliocs 


A 


H ' 

') 

Metals (kinds oO 

6 

i 

Uubbor 

d 

1 

Till 

fi 

1 

(c) Tobncco souvoiiirfl 



Cignr lioldors 

3 

I 

Cigflr Inga 

1 i 

1 

CiRflr tins 

t 

1 

Cignr stamps 

7 

2 

CiROt pAporn 


2 

Tobncco sneka 

a 

1 

Tobnooo tnoa 1 

2 

0 

(d) Objoota nsaoemted willi ivar, luintmg, ilsbrng, cto | 



Atrowkends ' 

7 

l 

Unllots or enrtridges 

10 

0 

Fish liooks 

10 

2 

I'liiit , 

7 

1 

Guns (toy) 

h 

1 

Knives 

10 

2 

Sbol 

1 

0 

Wampum 

1 

0 

War relies 

5 

1 

(a) Objoots need iii playing gnmes. 



'Marbles 

32 

5 

Marbles (ngato). 

22 

3 

Tops 

0 

2 

Kites 

7 

2 

(f) Miacollniiooiis objoots 



Bodscs 

Cl 

2 

Books, story 

0 

3 

Matolies 

2 

1 

Nnils 

H 

2 

Neckllts , 

5 

1 

Oil cans 

i 

0 

Padlocks 

5 

L 

Pnntguards 1 . 

1 

0 

Kubbtr abetU 

1 

0 

Sacks (^kinds of) 

o 

1 

Tags, shipping 

1 

0 

Tnge, tin 

<> 

0 

Trado marks 


1 

■ Wagon ftlioola 

0 

1 
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Table I (5) presents the names of objects which are used by girls for 
BeK-adorninent. Although most of those aiticles were collected to a 
limited degree by boys as well as by giils, they were collected with 
strikingly greatei fiequency by girls Fuilheimore, only one similar 
object (neoklie) appears m the boys* list Noticeable indeed is the 
fact that Table I (h) contains ten items In the conspicuous interest 
of the girls m this type of collecting and tho paucity of interest among 
boys theie is evidence of one clearly defined sox difference in behavior 
tiend 

It is apparent readily that this attempt at classification is arbitrary 
and theieforo somewhat inaccurate. For example, m Table I (c) aie 
listed the names of objects which possess sentimental value. It is 
obvious that almost any cherished possession may have a sentimental 
value It is equally true that piaotically any of the items listed in 
Table I may have been a gift oi a token, and therefore may have 
acquired sentimental value. Nevertheless, if one inspects carefully the 
two lists, he will grant undoubtedly that the girls* list contains many 
more objects than the boys* which generally arouse affective reaction 
and sentiment.* 

Table I (d) sets forth corlain items that are collected almost 
exclusively by girls, namely, dolls, doll clothing, etc This sex dif¬ 
ference would scarcely be conBidored phenomenal This list however 
considered with list I (c) brings to light eonapicuous and apparently 
general Intel ests of girls 

From Table I (/), it will be noted that the girls collect souvenirs of 
the schoolroom much more commonly than, do boys. No items of a 
similar nature appear in the boys’ list. (See Table II.) 

In the several lists presented in Table I (o) to (/), striking behavior 
patterns of girla appear. Girls are attracted by objects which may 
be used for personal adoinment; they assemble and appear to cherish 
much more than boys objects which call forth affection and sentiment; 
and they collect and keep lelics and portable objects which liave been 
associated with school life The latter tendency may be additional 


* It IS of interest that the only ifcomaof fcheentiioonohiindiedimiuty thatsuggeab 
buporBtitiouB belief, namely, ohaim sUmgs, and foui-lenf cloveis, woie ropoited 
more often by tho girla than by tho boys Sox diffcicnccs m thia logaid have been 
reported by tho wiiters m a piovioua article (See Journal of Ahnonnal and 
Social Psychology, Vol XXIII, 1028, pp 366-368 ) 
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evidence of the girls’ rathci intense liking for school. This likmg la 
less frequently found in the nonniil hoy “ 

The objects collected by the boya suggest their out door activity 
and rather vigorous play life This is particularly striking in the 
fust five classifications of Table II Perusal of this table shows that 
voiy few of the objects may bo described as ones winch possess {Es¬ 
thetic 01 seiiLinicntal appeal. And the lists contain fow objects which 
could be used for personal adornment Few of the girls collected 
objects which, by any breadth of imagination, could bo made to fit 
into the first four classificaliona of Table II. The things collected by 
the girls reflect the relatively naiiow geographical radius which cliavac- 
teiizes then lives The boys’ lists, howcvci, reveal theiy relatively 
great participation in activities ■which require a wide geographical 
sphere and uniestrictcd outdoor activity. 

TJio rather striking sex dilTcioncos found in Tables I and 11 seem 
to the writers to explain pnitially a finding reported by Miss Burk 
more than lluity years ago. Miss Burk reported: 

The boys oxcccd tlio girls soincwimt iii fiiuling and hunting, nncl conslderAbly 
in trading and buying Tbo girls exceed the hoys vci v grontlv as passive reoipieats 
of outeidc assistance, in having thoir things given to them hy brotheru, mstors, 
parents, unolca, aunts and fiionds. Ihit tlm excess of passivity on then pait» 
not balanced by any special decicaflo m the method of Ihvding, hut it rather bal¬ 
ances the excess of tiading, buying, and winning among the hoys* (p, 104) 

The preceding comment is corroborated by Miss Whitley. 

The pcrccnlngo of gnls dopemimg on gifts to a<l<l to tiioir colloctions is higher 
at all ages than il is for boys, nncl consistently lowci for tiading’ (p 250) 

The items listed in Tables I and II are not easily classifiable 
according to the "I'easons” which prompted the childion to collect 
them. Novel theloss, careful examination of the lists enables the 
reader to identify certain of the leosons for the sox difference in 
■methods employed in making collections In the girls’ list the objects 
which possess sentimental value (See Table I (c)) aie ones which 
possess also little or no practical utility. This statement is true 
regarding most of the items in the other lists, I (ti) to (/) Many of 
the items possessing rcsthetie and sentimental appeal are so perish¬ 
able that they have little or no value for trading or selling. Girls 

*This also IS inchoative of n sox difforonco m nttitiido that tiio wiiteis have 
previously tiismissed (Seo JSd«calio», Vol. XLIX, 1029, pp. 440-458 ) 
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appear to obtain many of their colloctious as gifts and boys actively 
assemble collections in order that sale or trade may ensue. 

Of course it is true that many objects collected by the boys aie of 
little actual value or utility. But there is this stuking difference 
between the guls’ and the boys* lists. All ion of tlie items listed in 
Table II (6) have a maikot value* and many of them have little 
value other than this The girls' objects of personal adornment 
probably have some market value, bub this value is no doubt usually 
outweighed by the affective appeal of the articles. 

There is one other nspeot of this point which is worthy of mention. 
It will be noted that the writers found it necessary to include a “miscel¬ 
laneous” grouping for tho items collected chiefly by boys. The 
girls' collections were more easily classified than were the boys’ 
This was due doubtless m part to the greater variety of objects col¬ 
lected by the boys. The great variabihty of this type of behavior 
among boys is due m part to their relatively great freedom to take 
part in outdoor life (as compared with girls) and their relatively 
vigorous, unrestricted play life. 

Because they have pockets m which they can carry about more 
easily than girls certain of the miscellaneous objects collected by them, 
the boys are clearly in a bettor position than girls to satisfy whatever 
desire they may have to trade objects which they have collected. 
This desire is also more easily met by the boys because of the fact that 
in their spontaneous play life they traverse a wider geographical 
area than do girls. This fact has been pieviously commented upon 
by the writers'* (p. 93). 

Although the above attempts to explain the sex differences in 
“method of and reason for collecting” ore of interest, it is the judg¬ 
ment of the writeis that such theorizmg has less value than knowledge 
of the actually observed tendencies of children If one accept the 
view that education is a matter of experience, that the curriculum 
itself is a series of experiences, it becomes at once evident that the 
boys and girls herein studied are not leceivmg the same sort of educa¬ 
tion. The pupils have themselves assisted in making their curricular 
differentiation, perhaps on the basis of genuine and deep interests. 
In any event, before the educator will be in a position to direct most 
effectively the child's education, he should acquaint himself with the 
child’s actual experiences 

* This 13 to be interpieted m terms of the juvenile nafcuio of boys’ trading and 
selling 
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errors, difficulty, resourcefulness, and 

SPEED IN THE LEARNING OF BRIGHT AND 
DULL CHILDREN 

PRANK T WILSON 
State Teaoheis College, Buffalo 

In a previous study'' the learning of bright and dull children was 
compared in a task of learning how to win a game m which two players 
alternatoly draw eithei one or two fiom a given number of pieces 
with the object of winning the last piece. Success requires the appli¬ 
cation of the piinciple that one's opponent must be forced to draw 
fiom a miilLiple of three at each of his plays It appeared m that 
study that for groups of childien nine and twelve years of age, half 
of each group at a level of 70 to 80 IQ and halt at liO to 120, the 
average difference of 30 IQ points gave advantage as measured by 
amount of work, to the brighter children, and that the average differ¬ 
ence of three years favored the older groups The difference in IQ 
seemed to be a little more important than that in ohronologioal age 
since, as measured m the study, the blight nine eventually somewhat 
surpassed the aocomplishmont of the dull twelve who averaged 
practically the same mental age, 

I. Explanation op inn Study 

This report gives the result of further study of the groups in this 
task m regard to the “Lost moves,” or errors made. Data for the 
groups are given in Table I, six additional cases having been included 
in the later study 


TABiiB I —Number op Cases 



1 Nine years 

Twelve years 


Dull 

Bright 

■1 

Bright 

i Total 

Boys 

8 ’ 

8 ' 

m 

7 

34 

Girls 

7 

10 

mtm 

8 

32 

Total 

16 

18 

H 

16 

06 

1 


* Wilson, Frank Thompson “Learning of Biiglit and Dull Children ” Bureau 
of Piibliontione, Teaclieis College, N Y. 
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The following explanation will make the references to the procedure 
of the task intelligible to the render. Complete explanations will 
be found on pages 12-16 of the first study 

“Paper clips wore used for the pieces. Each subject had thirty 
trials each day. A trial was considered to bo the senes of ‘draws 
mvolvcd In the reduction of any initial number (of clips) to 0, regard¬ 
less of whether S (tho subject) wins or loses.’ Pctcison, J. C.: The 
Higher Menial Piocessos in Learning. Psychological Mono{/?aplis, Vol. 
XXVm, No. 7,1020, p 3."! 

The learning was cained on for five successive days. The game 
was explained and illustrated to the subjects with three clips. The 
task was begun with four clips and each subject, after having won 
once with four clips, was told bliat he must \vm three times in succes¬ 
sion, the lulo which consUlutcd the entonon of successful learning 
of each stop, The game continued with the four clips. Having won 
three times in succoBSion with four the task continued in tho same 
manner with 6, 7, 8, 10, 11, 13, 14, 16, and 17 clips, or as far as tho 
subject worked in tho ono hundred fifty trials of tho senes. Tho 
experimenter was tho opponent of the subject, and liis draws wore 
always so made that tho subject would win if drawing correctly but 
lose if drawing incorrectly That is to say, tho subject could always 
wm if he applied tho principle. As far as practicable all other factors 
in the experiment were kept constant so that tho records show in the 
main, it is believed, difforencos duo to the differences m the subjects 
of the four gioups. 


IL Total Lost Moves 


Table II —Averach Ndmobr oif Losing Moves 


1 

1 

Nino years 

IVolvo years 

Dull 


Dull 

j Buglit 

Boys . . . ' 

91 3 

81 

82 

59 

Girls 

87 

84 

79 

79 

Total 

89 3 

82 7 

80 0 

09 7 


Table II gives tho average number of losing moves for each group 
and for boys and girls. There seems little question but that the blight 
> Ztid.. P. 12. 
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twelve year old group has the best record and the dull nine the poorest. 
The slight numeiical difference between dull twelve and bright nine 
gives no grounds for deducing a significant real difference 

Differences between groups by sexes as shown in these data are 
uncertain because of tlio small number of cases for the sexes, but the 
comparisons aro given as they mdicaie the desirability of further 
investigation. The most striking compariaoii is that of the bright 
and dull twelve year old girls, who made practically the same showing. 
The dull nine year old girls did nearly as well as the bright nine year 
old girls. In the case of the boys the diffeiences me decided between 
the bright and dull gioups at each age, while the two groups of the 
same mental age score the same. Comparing sexes it seems that for 
the bright twelve group the boys did very jnuch better than the girls. 
In the other thiee groups the differences are probably so small as to 
be statistically valueless. 

Conclusion 1.—From the straight count of losing moves made it 
seems that success in the task is moie probable for the bright older 
subjects and that mental ago is the most significant factor. 

Ill Same Lost Moves 

There was made next an investigation of successive same losing 
moves. Does the presence of differences m IQ and real age produce 
records for successive same losing mov^ which compare groups 
otherwise than do the rocoids of total errors'^* Table III gives the 
data for the groups by sexes. 


Table IIIA —Average Number of Times Sams Losing Moves Weeb Made 
Two OR. Morb Times in Sucobssiqn 



Nmo years 

Twelve years 

Dull 

Bright 

Dull 

Bright 

Boys 

14,8 

7 6 

MM 

6 3 

Girls 



mnsm 

10 8 

Total 

13 0 

Q 3 

. 10 1 

1 8 7 


The figures should be read as follows. The average dull nine year 
old boy made the same losing move twice or oftener in succession, 14.8 
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times m his one liunclrcd fifty draws, llie average bright nine year 
old boy 7 5 Iutigb; etc. 

Something new seems to be present m this iable The bright nine 
year old boys score better than the dull twelve year old and the diffor- 
rence is laigc. In fact the bright nmo arc nearer the bright twelve 
than they are to the dull twelve. The givls, again, limvcvev, make 
records nearly the same, except the dull nine who aio much poorer 
than the other girls. Their superiority over dull nine boys is not 
sufficiently coitnm to move tlian note, 

Tho significance of making the aamc losing move successively 
is not wholly cleat Questioning of subjects aflci experimentation 
brought out the infoimation that somcfciniea the same moves were 
made in order to study them more carefully to discover other possibilb 
tics. Such a process may have been moio ficqueiib with the bught 
Observation and introspection suggosl that somctiiiics tho same moves 
wore made because tho previous trial was not icmeinbcicd correctly 
and the suhjeoi thought he was playing difioronlly the second time, 
Such processes may have been more common with the dull. Table 
IIIB, although covering very few cases, emphasizes tho weakness of 
the dull nine in repeating the same losing moves many times. 


Table IIIB —Avebaqu Nombek op Times Samd Losinci Movn& Wuuh Made 
IM 3 To 9 Sucotessivfl Tiuals 




j Bii^t 0 

1 Dull 12 

Bright 12 

Samo movea* 

B||B 




Three bimca 


1 i 

1 9 

1 1 0 

Four times 

^Kh^H 

1 

1 .8 

1 3 

Five times 


0 

0 

0 

Eiglit times 





Nano times 






A complication in interpreting all tho data of this study exists in 
the nature of the dilfercncoa in the difficulty of tho successive stcp.s of 
the task This is a^eoted by tho praotico which goes on with leaining 
each stop as well as by the number of clips used in tho various steps. 
The subjects had varying amounts of practice on tho sovoral steps 
depending upon how quickly each woti three tunes in succession. Some 
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subjects had much practice on the early steps because of failure to 
wm the thice tunes Olheia Uwl Utllc practice in the early steps 
because they did vvm fchieo times with only few losses Yet the latter 
apparently doing bettei with the problem at first often, found later 
steps just as dilTicult as those who hud more tioublo at first. J?or the 
blight, however, it should be noted that, as they progicsscd farther 
than the dull of Lho sainp age, they had to woik with steps using more 
clips and, accordingly, having moic possibilities in the way of moves 
With those larger numbers of clips it seems that subjects intentionally 
repeated same movea in order to study the situation more thoroughly. 

Conclusion 2.—Analysis of successive same lost moves seems to 
indicate that biightnoss acts to reduce such eriors 


IV. Difficulty op Steps 

The difficulty of the stops, which it has boon noted just above, is 
uncertain., has been studied from, the data legardmg the number of 
lost moves by stops and gioupa. Tables IVA, IVB, IVC, and IVD 
show these data. 


Table IVA —Difficulty op Steps dy Groups Mbasured dy the Average 
Number op All Losing Moves 


Step 

4 

6 


S 

10 

11 

13 1 

14 

1C 1 

17 

Dull 9 

2 0 




31 s! 


1 6 

S 1 

.7 1 


Bright 9 

.0 



12 fil 

30 li 


4 3 1 

Q1 

8 1 


Dull 12, 1 

7 1 

1 4 

IH 

16 8| 

38 4 


3 3 1 


1 3 

05 

Bright 12 

4 

6 1 

0 4 1 

8 s' 

27 8| 


8 4 


1 2 7 

1 .4 


Table IVB —Difficulty of Steps by Groups Measured by tub Avbbage 
Number of Sams Successive Losing Moves 


CO 

4 

^ 6 

7 

S 


11 

1 

13 

14 

1 

1 

17 

DiilIO . , 

40 

33 1 

6 80 


4 33 

06 

,20 1 

m 

Rl 


Blight 9 

11 

.00 ' 



G 27 

1 22 

22 

H 

m 


Dull 12 

11 

11 ' 




1.26 

60 

05 

00 


Bright 12. 

.07 



1.27 


1 27 

,73 

07 

13 
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Table IVD IS an hypolliclical record made up by converting the 
number of actvml lost moves recorded foi cacli group into what those 
figiiics hypothetically become if one hundred per coiib of each group 
had been allowed enough Inals lo solve each slop. The iinihmctical 
sources for Table lYl^ are found in Tables IVA and IVC. Thoic is 


TAMiE IVG.—PEUCENTAon OF Eacii Gnoup Solving the Vauious Steps o? 

Tiin Task 


Stop 

6 

f 

7 j 

8 

10 I 

u 1 

1 

1 

14 

10 

17 

DwUO , , . 1 

WM 

H 

! 07 

7 

B 

m 

B 

B 


Bnght 0 

mm 


i iOO 

1 83 

1 


m 

B 

■ 


Dull 12 


100 1 

100 


28 

19 

,19 

H 


BiigUt 12 . .. 

bu 

too 1 

100 

SO 1 

73 


wm 

m 

13 


Table IVD —Difpiout/ty op Steps by Gnonrs MRAaounn by the Avehaqb 
Nembeu op Altj Losing Moves Cobubciku por One IIuNDniuD Pbu Cent 
S oLViNO Each Step 


step 

d 

6 

7 

8 


11 

13 

Dull 9 


2 2 

m 


417 



Bright 9 

C 

1 2 

IB 

12,6 

47 1 


26 3 

Dull 12. 

.7 

1 4 

7 6 

15 8 

67 3 

41 4 


Bright 12 

A 

B 

6 4 

8 6 

3d 8 


B 


considciablo probability that if all subjcols had been peimitlcd to 
work until each step had been solved as far as shown m Table IVD the 
actual records would be diffeient ns the practice obtained at one step 
would affect the work on the following stops. But oven granting such 
probability Table IVD doubtless represents the facts in regard to 
compaiative difficulty of steps morc tiuly than cither of the raw data 
in Tables IVA and IVB. If objection is made to this assumption, 
however, the raw figuies may be referred to as the same relative dif- 
feTenccs and comparisonB of groups nro found in them, although nob 
such stnkmg ones The figures for the larger numbered steps have 
little significance because few subjects reached them It seems, then 
that attention is warranted chiefly to the first part of the series. 
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The dull nine gioup found stops four and five much more difficult 
than did the other groups Step seven became a much more difficult 
problem for all gioups than the preceding ones, but for the dull nine 
it appears to have been vciy much more difficult, only eighty per cent 
of the gioup nlfcimately solving it and the aveiage number of lost 
moves at that step being 33, or collected, 41. Step eight appears to 
have been easier for tlio dull nine, at least after the practice they had 
had on the previous steps. There is a slight drop in the percentage 
which solved this step, but even so the corrected numbci of lost moves 
shows a smaller figure for step eight than for step seven For the other 
groups step eight seems to be harder than seven, The next step 
jumps the losing moves up to very much lughei figures, and from the 
table of the percentage who solve step ten this one is Waterloo to the 
dull nine. Only seven per cent survive its demands. The collected 
average number of lost moves thereby becomes 447. There seems to 
bo no doubt but that the difficulty of step ten, even after the previous 
practice of the task, is vciy severe for all groups. The next step, eleven, 
IS not quite so hard for the remainmg three groups, although it elimm> 
ates more than another one-third of the dull twelve For the three 
groups it 18 harder than any previous step, excepting step ten Pos¬ 
sibly the succcGchng steps are easier. The small amount of data for 
them does not warrant conclusions and none are theiefore made. 

Conclusion 3 —Apparently all groups found step ten the hardest 
as it was met with in this series. Relatively it was very much the 
hardest for the dull nine. For all groups but dull nine, the preceding 
steps increased in difficulty and the succeeding steps decreased in 
difficulty For dull nine step seven presented an extremely acute 
difficulty and step eight considerably less difficulty than either step 
seven or step ton. 


V. Resourobfolnebs 

Whethei or not this term is the coirect one to use, the data given 
in Table V show in a comparative way to what extent the difterent 
groups used successive same losing moves and other losing moves The 
figures foi each group give the per cent that the moves at each step 
were of the total number of the whole senes of steps. 

The table should be mad as follows* The dull nine made three pei 
cent of its successive sarao losing moves at stop four; two pei cent at 
step five; etc It would seem that, if the proportion of successive 



236 


The Journal of Educational Psychology 


same losing moves was greater than that of the other losing moves at 
the beginning of the task and if the proportion decreased toward the 
latter end, it would be leasonable to hold that subjects weie aban¬ 
doning a method of little ox no leturn for some other method of more 
piomlse. 

The figures m the table indicate a slight superiority of the bright 
gioups over the dull, especially if the per cents are totaled for steps 
four to ten Blight twelve, which made the best progress in solving 
the problem, lias a much better record than dull twelve and the bright 
nine show a better score than dull nine. 


Tatjlh V —Per Cent at Each Step That Same Losing Moves Ann of Total 
Same Losing Moves Compared with Per Cent at Each Step That All 
Other Losing Moves Arb op Total All Other Losing Moves 



Steps 

Total steps 
4-10 

4 

5 

7 

8 


11 

13 

DullO 






1 

y 


Same losing moves .... 

3 

2 

43 

15 

32 

B 


98 

Other losing moves 

3 

3 

37 

20 

37 

y 

■ 

100 

Bright 9 • 







■ 


Same losing moves 

1 

1 

7 

17 

67 

13 ! 


83 

Other losing moves 

1 

y 

8 

16 

47 

21 

y 

73 

Dull 12- 


y 







Same losing moves 

a 

B 


27 

44 

13 

6 

33 

Other losing moves 

11 

2 



60 

14 

4 

83 

Bright 12 

■ 








Same losing moves , 

11 

a 

13 

16 . 

47 

16 

8 

76 

Other losing moves, . ,, 

y 

u 

9 

12 

40 

13 

13 

63 


Conclusion 4.—In the kind of “leaourcefulness'' shown in Table 
V brightness seems to be significant 
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VI. Speed op Lbahninq 

Table VIA —AvnnAGB Numbbu op Total Losing Moves for Each Day 


Boys 

Gills 

Total 

Dull 

Blight 

Dull 

Bright 

Dull 

Bright 


Nino Years 


1 

17 3 

11 3 

12 0 

9 2 

29 3 

20 6 

2 

16 0 

14 4 

17.3 

16 4 

32 3 

30 8 

3 

17 8 

12 a 

16 6 

19 2 

33 4 

31,8 

4 

22 7 

24 3 

20 7 

20 3 

43,3 

44 6 

6 

20 0 

18 1 

21 3 

10 2 

41.3 

37 3 

Total , 

91 3 

80 6 

87 0 

84 3 

j 179 0 

166 0 


Twelve Years 


1 

10 

3 

7 

4 

9 

3 

8 

8 

10 

6 

16 

2 

2 

16, 

,6 

11 

1 

16 

0 

16 

3 

31 

6 

26 

4 

3 

18 

7 

14 

0 

18 

1 

17 

9 

36 

8 

32 

8 

4 

16 

6 

13 

1 

17 

7 

17 

5 

34 

2 

30 

6 

6 

19 

8 ' 

12 

1 

10 

3 

19 

0 

30 

1 

32 

0 

Total . ..' 

81 

9 

68 

7 

79 

.4 

79 

8 

101 

3 

138 

,0 


Table VID —Averagb Number op Same Losing Moves Each Day 



Boys 

Girls 

Total 


Dull 1 

1 

Bright 

Dull 

Bright 1 

Dull 

Bright 


Nine Years 


1 

2 4 

' 1 1 

3 6 

1 3 

2 9 

1 2 

2 

2 3 

1 6 

2 8 

1 6 

2 6 

1 6 

3 

1 4 

2 9 

2 g 

1 1 

2 2 

2 1 

4 

3 3 

2 8 

2 6 

2 1 

2 9 

2 6 

6 

3 4 

2 4 

3 8 

1 4 

3 3 

1 9 

Total 

12 9 

10 7 

14 8 

7 6 

13 8 

9 3 


Tryelve Years 


1 1 

9 ' 

1 1 

1 1 

1 1 

1 0 

1 1 

2 

2 4 

1 8 

2 3 

1 1 

2 3 

1 6 

3 

1 7 

3 2 

2 1 

1 3 

1 0 1 

2 3 

4 

1 4 

2 6 

2 3 

1 6 

2 0 j 

2 1 

6 

3 3 

2 3 

2 5 

1,1 

2 8 ' 

1 7 

Total. . 

9 7 1 

10 9 

10 3 

6 2 

10 0 

8 7 
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Table VIA gives the figures for the average number of total losing 
moves by sexes and groups for each daily set of thirty trials Table 
VIB gives the figures for the aveiage number of same losing moves by 
sexes and gioups for each daily set of thirty trials This arrangement 
of the data sho-ws something as to the rate at which enois decreased 
or increased duiing the series of one hundred fifty trials Using the 
bright twelve year old boys as suggestive of the most efiicient learning 
it is found that in both tables that group increases its average number 
of eiiors through the second and third days and then progressively 
decreases the number for the fourth and fifth days. With more or 
less irregularity either the opposite takes place with nil the other 
gioups, that is each tends to increase its cn’ois fiom day to day, or 
they fail to materially i educe the errors The bright nine year old 
boys offer the most irregularity. One is in doubt m legard to this 
group whether to believe the number of errors tends to inciease 
throughout the first four days and then tends to decrease, or whether 
the apparent great difficulty of the fourth day really belongs to the 
third and fourth days and means that progress remains about the same 
after the second day. 

Conclmion 5 —Measured by frequency of errors it seems that 
brightness operates to decrease errors more quickly. 

Summary Discussion 

Comparison of bright and dull children in certain noted reactions 
of the complex process of the task of this study shows for the groups 
of the experiment that on the whole the older and brighter children 
react more efficiently than the duller and younger. The noted differ¬ 
ences are not, however, certain differences in all cases The certainty 
seems best for bright twelve year old boys 

Two obsei vations may be made m view of these findings Each 
has merit and the two lead to an hypothesis of importance. First, 
whatever real diffeicnces may exist between the foui gioups studied, 
each group and every last subject m each group, made appreciable 
progress along tlie same lines of effort. Dull and bright, young and 
old solved steps m the problem as measured by a piactical, common- 
sense criterion of every day kind, namely: Repeated success in getting 
the desired result—in this ease winning the last clip three times in 
succession at each step It took the dull and younger a little longei 
to advance from step to step, but by the same measure of success 
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they did advance several stops They made errors, to be sure, but 
the brighter and older ones also made errors and the same kind of 
errors Individually some of the brighter ones, also, made more 
errors and progressed moio slowly than some of tho dull ones 

This observation of the general ability of the dull groups to pro¬ 
gress along tho same lines as the brighter ones is an interesting ono 
to keep in mind m view of the often heard statement that dull folks 
are not headed m the same direction ns bright ones. 

The second observation offered is that peihaps tho gross nature of 
the measurements used m the records failed to reveal the importance of 
the differences really present Thiee illustrations of such apparently 
small but significant differences, are found in leputable mental tests. 
Gesell in his sciicclules for studying the mental growth of the pre- 
Bchool child rates an infant who “unmistakably articulates" two 
words in addition to ma-ma oi da-da aa a very high nine months old 
child; while five words, only thico more, places him ns very high at 
twelve months. That means that at this period of life just three 
moie words make a warrantable addition of 33^^ per cent in estimated 
mental development In the Stanford revision of the Binet test 
the exact lepotition of 12-13 syllables is given for the fourth year; the 
repetition of 16-18 syllables for the sixth year; 20-22 syllables for the 
tenth, 28 syllables for the sixteenth Thirty words in the vocabulary 
test place one at ton years; forty at twelve; fifty at fourteen, sixty-five 
at sixteen, and seventy-five at eighteen. The nature of tho task 
studied in this report may very well be so complex and demanding 
that the small differences recorded in tlie data really mean great 
differences in ability 

If this conclusion is tenable a following general conclusion is 
justified and, it seems, highly significant. It la, in words of the day, 
that the ability of the dull and young subjects in this complicated 
problem is not to be laughed at How far they have gone from the 
true zero point can not be said, but if the small recorded diffeience 
between their ability and that of tho bright is so much that it stands 
for a large real difference, then the differences between the arithmetical 
zero of these data and the points scored by the dull groups must stand 
for a truly groat amount of ability, certainly for so much that m it is 
promise, not despaii 

Final Conclusion .—Dull nine and twelve year old boys and girls 
found the complex task of learning to win n game, success in which 
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depended upon the application of an underlying pimciple, more diffi¬ 
cult than did bright nine and twelve year old boys and girls, when 
their success was estimated in teims of fiequenoy and repetition of 
errois. The dull did piogress, however, and the bright children 
made the same kind of errois hut fewer of them. 
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SELF-CULTIVATION AND THE CREATIVE ACT: ISSUES 
AND CRITERIA! 

HAROLD RUGG 

Tcncliors College, Columbia UinvorBity 
1 

No contribution of the child-centered schools is greater than the 
discovery of the principle that only an artist-teacher can discover 
and develop the artist in tho child. Only one who has lived through 
the art experience can provide art expeiiencca for the children; that is, 
one must himself have tho attitude of a creative person m order to 
develop children into creative persona. This is the important generali¬ 
zation that emerges from the scores of creative artists m our now 
schools dming the past fifteen years. 

But the cultured person is both pragmatist and artist, both a 
maker and door and a creative apprcciatoi of life The complete 
educational program, theiefore, must embrace the attitudes, concepts 
and techniques of tho creative and appreciative individual as well as 
those of the problem-solver Now to develop the instrumental values 
and activities of life a monumental library has alieady been produced 
under the leadership of Mr Dewey. But of the criteria for the 
education of the Man-as-Artist little has been said. 

It was to the concepts of the artist that we turned in our attempt to 
sketch a balanced portrait of the integral peison. In him we perceived 
the guiding concept' The intcgnty of one’s own self . . one’s authen¬ 

tic inner truth as the true criterion for judgment and for conduct . . 
admiration for every well-thought-out peisonal philosophy It is 
the Man-as-Aitist who la sensitive to the criterion of integrity, who is 
dominated by the attitude of appreciative awareness The true 

* Chapter XIX of tho author’s foithcoming book, "Culture and Education m 
America.” Harcourt, Brace and Company, Now York (In press ) 
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craftsman is he who stresses Feehng-Iraporfc, who gives creative 
desire a place coordinate with mtelligence He sees man whole and 
in turn visualizes the nation as a multitude of integral persons. Corro- 
spondmg, it is the artist m the school who is concerned with the 
pioduction of persons, not piimaiily with developing professional 
poets, painters, actors, thinkcis, or musicians. Hence the source for a 
psychology of the creative act lies in the experience and the vision of 
the artist himself 

In addition to possessing a sensilivcncss to the noims and criteria of 
the creative attitude there is another fundamental qualification for 
serving as the artisL-tcaeher That is, the sensitiveness to the potential 
artist in the child and his methods of work The development of 
creative education in the schools depends moie crucially upon the 
adoption of the “drawmg-out” attitude by the leachei than it does 
upon his mastery of technical knowledge and skill in manipulating the 
materials of one art. The cioativc teacher has this attitude He 
regards every child as a potential aiLiat, each in his own modicum of 
creative powei. Hence, the artist is a sensitive hstonoi to childhood 
As Miss Levin puts it: “ You have to feel the thing ilio child wants to 
do, to think his thought, m short, become a child yourself ” 

The educational conclusion from such postulates is clear In 
order that childicn shall become self-expicssivo oraftsinen with 
woids or tone, with clay, wood oi stone, with light and shade, the 
teacher must be a craftsman with those maleiials. Thus, and only 
thus, can he become sensitive to the potential person in the child 
This was the epoch-making message of Hughes Mearns. It was like¬ 
wise the stimulation given by Satis Coleman m her “creative music ” 
So the theme recurs with the materials of painting, sculpture, the 
dance, or the diama. Thiough each medium of self-expiession 
children develop the ability to express themselves honestly, creatively, 
and to grow as persons only to the extent that the teaohei’s attitude 
and procedures provide for them. 

Thus, the significance of the entiance of the artist into the school 
18 as great as his discovery of the aitist in the child It is through 
creative production in the school, in the homo, in every social agency 
that children receive piactice in developing the integral of one's self 
They learn to measure themselves against ciitical inner standards 
Children must ask* Is this poem I have written leally “I"? Is this 
house I have made, this music I have played, utensil I have con¬ 
structed, brief I have prepared, oration I have delivered, as close an 
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approximation of my true self as I can make it? This is the criterion 
which the artist ruthlessly applies to himaclf, and this is what he has 
contributed to the creative phases of the new education. 

He has recognized attitudes, points of view, and techniques which 
arc indispensable in the education of the cultured man Thus he 
oifei-s an important contribution to general education as well as to the 
development of potential artists. 


2 

The scientific attitude is analytic, and the method of work con¬ 
centrates upon the systematic collection of facts measuied on scales of 
equal units, the discovery of reciiirences, uniformities, “law ” 

The artist's attitudo, however, la integrating, all-embracmg, 
appreciative. The artist “measures” but against the unique inner 
norms of his own peculiar experience, not against external standards. 
Correspondingly, hia goal is nonuniformity, the unique individual 
thing Whereas science emphasized the adjustment of the individual 
to an external norm and seeks the confirmation of generalizations, art 
on the contrary shuns repetition and denies the possibility of confirma¬ 
tion or refutation 

These distinctions set the stage foi our study of the difference 
between the methods of work involved in three essential kinds 
of activity: (1) Intelligent problem-solving, (2) creative produc¬ 
tion, (3) appreciation Phrased another way, the question amounts 
to this' What are the likenesses and differences among these processes? 
Students of the creative not maintain that there is a difference between 
the process of problem-solvmg (in which assimilation plays the leading 
r61e) and that of creative self-expression and contemplative awareness. 
The instrumentalists deny this They maintain that the assimilative 
act and the creative act are merely differing aspects of the same 
general procedure of learning. Always protagonists of the unity of 
experience, they maintain that those who distinguish between “assimi¬ 
lation” and “cieatiou” are resorting to a dualism Since the discus¬ 
sion throughout the book has emphasized the unified character of 
human experience, that criticism does not apply in the present instance. 
The distinctions whioh aie now to be pomted out are of another type 
At this point we must remind ourselves of the current tendency to 
apply the word “creative” to any kind of active vigorous leaining. 
Such a tendency is conspicuously evident just now among educa¬ 
tionists Lectures by professors of education and others subsume 
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under the caption "creative" the most obvious kinds of repetitive 
learning, mastery of skills, and acquiring of information Nothing 
but confusion can como from such a careless use of meanings and 
vocabulary 

Next, a woid concerning the data and the method of my analysis. 
The data are the subjective materials of experience, and the method 
is that of introspection, or rather retrospection Wc are studying the 
mental and emotional experience undergone in the creative act. It; is, 
theiefore, only by the introspection of the mealive artist that the 
experiential data of the process con be exploied. No person who 
has not experienced this process con generalize concerning it, and no 
objective measure of products can lay bare the process itself 

Hence my description of the creative process is based upon oooa* 
sional flashes obtained in the autobiographical liteiaturo of creative 
artists and creative scientific men, fiom similar examples of intuitive 
understanding obtained m conversations with such persons and from 
my own introspections. (In earlier years 1 had prolonged contact 
with the processes of the scientific method both m physical and 
intellectual technology In recent ycara I have devoted considerable 
energy to the creative arts ) 

The techniques of introspection and retrospection must not be 
deapised They wc the only possible means of exploring “processes” 
of learning, They are mdoed the techniques used by Profeasor Dewey 
m his famous analysis of "the complete act of thought”^ (that is, the 
complete act of problem-solving, foi Dewey is considering only one 
type of thought) The vaUdity of that subjective analysis was 
established, of course, by the confirmation that came fiom the cumula¬ 
tive, introspective analyses of other studenla of problcin-solvmg. The 
validity of my present analysis of the creative pioccss must be estab¬ 
lished in the same way I am only too well aware of the difficulty 
which the creative artist encounters in giving utterance to the kaleido¬ 
scopic succession of his complex inner states. Neveitheless we must 
attempt the task and to do so we must put ourselves in the attitude 
of the artist Only so can we make a valid record of our expcncnccs 

Furtheimore, as I said before, no objective mcasuicroent of 
products OP of overt behavior will portiay the inner process itself 
That is clearly illustrated in the monumental work of Thorndike and 


•Dewey, John “How We Think,” D C Heath and Company, Now Yoik, 
1913, Chap. V 
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Judd in reading, and of BVeoman m handwriting Thorndike meas¬ 
ured the producti of reading; Judd and Freeman measured the overt 
signs of the processes themselves, that, is by the photography of eye- 
movements m reading, by hand and fingei movements in writing 
But even the latter did not record the experiences which produced the 
behavior of the product What they are can only be inferied and, 
indeed, only approximated by the caieful introspection of the person 
himself. 

3 


What, then, is our task? It is the analysis of thiee ways of 
knowing. Problem-solving, creating, and appreciating Let us begin 
with an analysis of the four aspects of the learning process. First, the 
attitude of orientation; second, the initiation of the act; third, the 
ongoing piocess itself, fourth, the definiteness with which the achieve¬ 
ment of the goals can bo ascertained, that is, the possibility of confirma¬ 
tion or refutation. 

In analyzing these we shall postulate the imified natuie of experi¬ 
ence We shall conceive of each human icsponse as an integration of 
physiology, intellect, and emotion. No dualistio separation of 
faculties or elements of response is implied in my discussion. On the 
contrary, it is assumed that the organism responds as a unit, and 
every act is conceived as a fusion of sensori-motor set (attitude), of 
meaning, of generalization, of language, gesture, and other overt 
movement. Life is a succession of infimtesimal expciiences, each a 
complex weld of the many kmds of process with which the human 
organism has the capacity to respond The human act is not mosaic; 
it is fusion. 

Neveitheless, our argument is that all human acts are not alike 
For example, the tendency to flee from a situation is unlike the tend¬ 
ency to embiace it and we give different names to them. The 
emotion of anger is unlike the emotion of love and their descriptions 
vary accoidingly One act is oriented by one attitude, another by a 
very different one One makes much use of meaning and generaliza¬ 
tion, IS predominantly intellectual. Anothei, howevci, is predomi¬ 
nantly motor response, calling into play but few intellectual elements. 
Still another may be hyper-sensoiy, involving little oveit movement 
but much internal kinesthetic response—a gathering-together piocess 
highly charged with emotion Thus the composition of human acts 
vanes greatly. Hence, in exploimg the acts of problem-solving, 
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creating and appreciating we shall expect to find similarities and 
differences in Iheir constituent elements. 

4 

Consider, first, the attitudes oiienting the act of pioblem-solving. 
In confronting a problem, the worker is oriented outward. The 
conditions of the problem are "given " Here are some examples: 
One has to find the distance between two points, to discover the 
combination of elements which make up an unknown; to design an 
engine of known-in-advance horse power, cylinders, and the like, 
to determine the most favoiable disliibiition of practice required to 
produce a desired amount of skill, or to determine the dimensions of an 
I-beam which will withstand known-in-aclvniicc loads. 

In each of these "problems” the attitude is set in reference to 
external needs To grasp the problem, the individual must adopt the 
attitude necobsiiry to understand the conditions set by it. As Dewey 
has said, unless the individual can perform an indicated set of opera¬ 
tions, he cannot respond with its meaning, that is, unless he adopts 
the attitude appropriate to the problem he cannot understand it. 
This is the essence of the active psychology of meaning built up pri¬ 
marily through the efforts of Peirce, James and Dewey It^ is only 
by striking the attitude ligoiously deleiimned by conditions outside 
his own experience, external to his background of meaning and 
generalization, that the problem-solver successfully recognizes the 
“felt difficulty” in the "forked-road” situation. 

In the creative attitude, however, the oiientation is inward 
It is subjective, not objective, as m pioblenri-solvmg The creating 
process is piopelled by an inner urge to objectify moods, to portray 
overtly personal integrations of meaning, generalization, and emotion. 
The drive may be to write a poetic phrase or line oi stanza, to poitray 
something with pencil or brush, to put together a new combination 
of tones or bodily movements that will objectify a fusion of ideas 
and feeling But the attitude adopted in the initial stage in the 
creative act is determined by reference to the subjective, inner experi¬ 
ence of the individual 

There is also a second distinction, Wheieas the "problem" 
of the problem-solver is external to the individual, the "problem" 
of the artist is internal. There is a difference in definiteness. Prob¬ 
lem-solving IS focussed with sharpness upon conditions prescribed 
m the external world, such as the loads, span, strength of materials, 
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etc involved in the design of the I-beam, the location of points involved 
in the determination of distance, or the piescribed horse power, 
iiumbei of cylinders, etc in the design of Iho engine The problem- 
solver must adjust with exactitude to these externally prescribed 
requirements 

Not so with the orienting AlUtude in the creative act It consists 
at first of little more than a vague lesllessncss, an undefined desire 
to express m an external product the internal cxpci lence of the individ¬ 
ual This gives us, indeed, nn important cue to the difference between 
problem-solving and creating; that is, the unchanging rigor and 
clarity of definition of the exlernolly-set problem and the constantly 
changing indefinite character of the artistes subjective vision. 

Now compare the appreciative attitude with that of pioblem- 
splving and creating The first has resemblance to both the second 
and third, but it is much more like the creative attitude than that 
of problem-solving. What are its elements? Although it is stimu¬ 
lated by external conditions, it is not really oriented externally. It 
IS oriented by the internal personal gathering-together of the self. 
In appreciating a lone-poem, a dance, a painting, statue or a building, 
the individual does not strive to compiehend the meaning of the 
artist, the dancer, or the designer He strives only to catch the 
coordinate whatever reverberations come from the observed thing 
Although stimulated from the outside he makes the response, the 
interpretation which his own mood, experience, and needs call 
forth He '^appreciates” in terms of what he is, what he feels and 
understands It is a sort of confident gathering together of the whole 
personality It is an attitude of awareness, as well as one of critique; 
it is all-embracmg rather than analytic 

In all three of these attitudes there is of course meaning, gener¬ 
alization, physical adjustment and emotional content, but there are 
distinctive differences in their amount and integration. The apprecia¬ 
tive and creative attitudes are efifective only to the degree to which 
they are highly charged with emotion The problem-solving attitude 
is effective only to the dcgiee that the woiker maintains emotion at a 
low ebb. This does not mean that the problem-solver is not also 
gathercd-logetlior emotionally. He is concentrated intently upon 
his task Sometimes a thrilling orientation is perhaps essential to 
success On the other hand it is frequently the emotional intensity 
of concentration which inhibits the making of appropriate 
generalizations 
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So much, then, for the tliffei'cncea m orientation of problem-solving, 
creating and appreoiabmg. 

5 

Consider, next the similanties and diffcionces in launching tho 
acts themselves. Dewey, m h\s claaaic analyaia of the complete act 
of thought, leads us to the atop immediately following the recognition 
of tho problem—the flashing up of siiggosUons oi solutions In the 
case of pjoblem-solving these solutions arc hypotheses drawn from 
known data They aie tested against the requirements of the prob¬ 
lem, They are generalizations drawn from ‘Tacts” and are accepted 
only when under scrutiny they fit the facts 

In the creative act also this flaah-liko succession of fused emotion, 
meaning and movement resembles closely the successive appearance 
of solutions in problem-solving. But, aS in the original orientation 
of the work, there arc shaip distinctiona between tho two processes 
The “suggestions ” which hash up to the problem-solver are hypotheses 
from known data. The meaning of each is precisely fixed; generaliza¬ 
tion must fit the conditions act by the problem itself. In the creative 
process, however, the suggeationa for modifying the art product are 
measured against tho changing subjective experience of the person 
himself. “Solutions” are accepted only as he perceives that they 
correspond to his felt moods Thus the point of reference in this 
creative entorpriac is subjective. 

In appreciating, “analysis” of a kind undoubtedly does play a 
part as it does in problem-solving and in creating. In listening to a 
Symphony our enjoyment is enhanced, for example, by noting the 
recurrence of themes, the manner m which the tones of particulai 
groups of instruments merge with others, and the like. Our apprecia¬ 
tion of a poem or ot prose writing undoubtedly is augmented by 
mastery of form and style which opens to our emotional oompielicnslon 
varied channels of enjoyment. Illustrations could be multiplied for 
other media of expression. Theie is no doubt, therefoie, that m the 
fullest development of the appreciative act, the mind attends to 
separate phases or aspects of the process as well as tlic ensemble 

As m the creative act, however, there la a fundamental distinction 
as to point of reference There is no attempt to make the symphony, 
the landscape, the statue fit mto presciibecl objective standards, 
Wo take fiom the situation what we can. We integrate it with our 
on-flow of experience, but we must not interrupt the process of lecep- 
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tive awareness to dissect critically and judge the "validity of the art 
product If we should do the lattei, then the process becomes one of 
pioblem solving and not of appieciatioii. 

G 

Third, considei the ^‘methods of work,” the on-going procedure 
itself m pioblem-aolving, cieating and appreciating 

In problem-solving the individual "collecta,” classifies and 
compares facts If they aic multitudinous, he condenses and sum¬ 
marizes them by statistical devices These facts arc measured 
against the scales of approximately equal units. Since I have dis¬ 
cussed this process in earlier ehapteis, I shall merely summarize the 
argument by saying that the whole process of problem-solvmg is one of 
drawing generalizations which fit the external requirements of the 
problem. 

How diffeient is the cieativc method of work. The "facts” are 
the Imea, words, or phrases that well up out of the inner recesses of the 
artist’s expeiienco. They are the tentative modelings in which the 
sensitive hands of the sculptor or painter attempts to objectify his 
moods and his vision They are the imagined arrangements of light 
and shade, color and materials m the stage-set and costuming of the 
scenic designer They aie the apparently uncoordinated arrangements 
of materials, dimensions, machine or instrument parts of the mechan¬ 
ical inventor. They arc the interpretive bodily movements of the 
dancer responding to music. 

These are the "facts” of the creative process Are they measured 
against external and precisely standardized norms? No, they are 
measuied against the artist’s umque inner sense of the total situation 
to which he is responding. The succession of experiences is a proces¬ 
sion of changing, complex, unique situations. Hence, the utter 
impossibility that the artist shall systematically assemble meanings, 
lines, woids, color, what-not m teims of externally known-m-advance 
conditions As with the orientation and initiation of the cieative 
act, the on-gomg process of the work itself is essentially objectification 
of moods, slowly, defining'images, gradually shaping mental and 
emotional complexes 

Obviously, meaning and generalization play a selective and 
interpretative i61e as well as emotion Again we say that the creative 
experience is a fusion of phyBiological processes, meaning, kmaeathefcic 
and emotional reaction. Hence, intellectual elements play a part— 
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peihaps a guiding, orionliiig pari. Definitely what part meaning, 
reacted-through-words plays in doteimming the actual step-by-step 
advance of the artist’s work wg cannot say at the present stage of the 
analysis of the creative act We lack definitive rotiospoctivc studios 
by creative artists of the development of their work 

It IS clear, however, that the “analysis” that leads the artist to 
"correct” words or phrases, shapes, lines, arrangoments of material, 
light and shade, combinations of tones, bodily movements is & fusion 
of emotion and intellootual meaning. Ideas play a decidedly impor¬ 
tant selective r61o in dealing with media that are piimanly mtollGctual, 
that IS, words in poetry and essay, and symbols \n mathematical 
invention But they play a very minor building rdle m dealing with 
the media of the giaphic and plastic arts, music and the dance Here 
feelmg-import ousts ideas as the directive agent. Thus it is clear that 
analysis plays a part in the carrying on of the creative method of work 
as well as in problcm-solvmg 

This shows itself conspicuously in the conscious effort with which 
the artist gathers himself together, determinedly focuses his mind 
upon the manifestations of his moods, and drives himself to define 
the vision which seivcs as his inner goal Thus ho adopts an attitude 
of ruthless criticism of the objective portrayal which is appearing on 
his canvas, m his statue or musical composition To tho best of his 
ability does it correspond with his inner vision? New relationships 
are consciously sought, now combinations of words, lines, tones, 
shapes There is a rigoious seaieh for new clcnionts m design. There 
13 a dogged detcimmation to discover and build upon unifying themes. 
This process inevitably sharpens the vision as well as produces a 
maturing objective expression Thus the on-going analytical piocesB 
of the creative act clarifies both the mnci subjective state and the outer 
objective product, 

The goal in the act of appreciation, as wc have already pointed out, 
IS fullest awareness The governing attitude is a gathered-together 
receptiveness, an attempt to embrace all the rcvciberations that radiate 
from the words, the tones, the lines, the masses of color, or the move¬ 
ments of the body, in the stimulating situation The process is es&cn- 
tially one of "listening, ” not of making and doing. Hero is an example 
of "assimilation” that is closely akm to the cicaUve act and quite 
foreign to the "assimilation** of the problem-solving act, In appreciat¬ 
ing we assimilate stimuli of tone, movement, or word-meaning, into 
our curient moods "We "enjoy,” thrill over the new assimilation. 
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We build iL into oui “expeiienco ” We accept it, ombiace it, aie 
lifted up, earned onward 

"Analysis” plays its constructive paiL in appreciating also, but it 
is more like creating than problem-solving. In music, for example, the 
individual "notes” the use of specially related tones and chords, the 
recurience of basal themes, the integral unity of the composition To 
the extent that ho is a master of the technical foims of constiuction, 
his enjoyment is enhanced by the recognition of the artist’s techniques. 
Thus analysis leads the listener to oicate a new inner pioduct; his 
fusion of impressions is unique; it is "himself” living on the maximum 
heights of appieciation 

But he does not analyze in order to reproduce m himseJf what the 
artist felt and saw in creating the product * If he does so it happens 
by chance, not by design. That is, he does not analyze to "solve an 
externally-set problem ” If he questions, foi example: “Do I get the 
artist’s intent?” he at that instant turns from appreciating to prob¬ 
lem-solving. 

7 

There is a fourth difference to be noted—namely, the difference in 
the definiteness with which the goal of the worker can be visualized and 
the success or failure of achieving it ascertained The problem- 
solver knows in advance the problem he is to solve. It is the discovery 
of the “law” of relationship between factois that change together. 
His method is to discover the exact combination of factors—materials, 
volumes, loads, pressures, repetitions, lengths, masses and the like— 
which will bring about the stated conditions The very statement of 
the pioblem fixes piecisely the goal of the worker, it is unchanging 
throughout the entire mental process 

Not so in the production of a creative thing The goal is the 
clarification of the artist’s vision and its objectification He must see 
and feel clearly enough to portray his vision on a canvas, or in a poem 
or dance or musical production The goal of the eicative aitist, 
therefoie, changes constantly The natuie of the creative process is 
tentative and hesitant, there are constant interlineations, erasures, 
the givmg-up of old achievements, the adoption of new experimental 
arrangements Hence, also, theie is the continual attitude of 
discontent. 


‘ Hence tlie futility of mosit “eiiticism” m the artsl 
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One more important distinction remains to be noted between 
the outcome of pToblem-solvmg and cieativc production. The 
solution of a scientific problem can be defimleiy conhiincd or refuted, 
that of the artist's problem cannot. It is of the essential nature of 
scientific work that a generalization once achieved m the solution of a 
pioblcm IS susceptible of exact confiimation by independent workers 
at other times and places. Indeed, inferences drawn by the scientific 
worker are not regarded as scientific "law” unless they can be exactly 
confirmed by other workers utilizing the same set of procedures. 
Thus, a central element of the scientific method is the inevitability 
of the discovery of recurrence. 

Exactly the opposite is trae with the creative product The goal 
of oreative production must be a unique thing It is a painting, a 
poem, a tone poem, an oiation, which is an objective portrait of an 
inner personality Hence the impossibihty of confirmation, or of 
refutation of the product of such a personality by another 

By what standards shall its confiimation be measuied? By 
whom is it to be oonfiimed or refuted? The product is the artist’s 
personal record of Self. At any given moment no two human beings 
in the world are even approximately alike Thus it is inconceivable 
that, except by the remotest operation of chance alone that the peculiar 
fusion of feeling-import, menamg and bod\ly understanding achieved 
by an artist could ever be achieved by another. And if they weie so 
achieved, it would not be a "confirmation” of the original artist’s 
‘‘‘generalization ” It would oithei be sheer imitation, or a new onginal 
product of the second artist. If it wei*e the latter, it must be meas¬ 
ured against his personal vision, not against that of the first artist 

S 

Our comparison of the acts of problem-solvjng and of creating 
throws light upon the curicnt confusion of thought concerning “lepre- 
sentative art” and "creative art” m the schools Wo can see now that 
these differ definitely, but that each is necessary in the education of the 
cultured youth and in the progressive reconstruction of society. 
Each plays its important r61e m developing tolerant undeistanding and 
dynamic participation in modern life. To get the issue clearly before 
us let us first illustrate whftt la meant by “representation, ” by “repre- 
sentative" art, 

Prom the classrooms of the child-centered schools emerge a host 
of thrilling illustrations of the use of representative art In a first 
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grade unit on local community life is a model of a miniature city. 
Grocery store, post office, city hall, town park, railroad station, each 
item made by a pupil in the class. Together these part-way creative 
products constitute a representation of the community. 

Likewise, m the fourth gindo is a more mature repieaentation of 
the community, a map drawn roughly to scale show'ing the districts 
of the city, rivers, chief industries, names of transporting and communi¬ 
cating facilities, schools, municipal government buildings, and residence 
districts Here, too, is “representation,” of a more mature type, 
however, than that of the first giade “play city,” 

Consider another—a dramatization of a play written by children 
in the fifth grade depicting stages of community development. 
“Research” has been earned on by the young people to make the 
costumes, appearance of houses, farms, factories and stores “represent” 
fairly the civilization depicted, 

A sixth grade class has beon studying the European background 
of Ameiioan history Witness the models of medieval castles and 
towns, a painting depicting life on an English manor, another illustrat¬ 
ing transpoitation in the sixteenth century. 

These examples, culled from the experimentation of the new schools 
thiow into clear relief both the Importance of representative nit in the 
schools and of its essential chaiacteiistics. At the same time they 
provide us with clear illustration of the distinctions and the similarities 
between representative art and creative art. Note these succinctly. 

First, representation employs the essential altitudes and procedures 
of problem-solving. The individual confronts a problem, namely 
that of portraying with relative fidelity the life of the region, group or 
period, or the structure and form of the plant, animal or society under 
consideration. The orientation, is upon a stated set of conditions, 
factors, needs, it is outwaid toward an externally set problem 

Second, the student collects “facts” as in problem-solving He 
searches foi historically correct models, for information conceimng 
costumes, modes of transportation, language, what-not In “repie- 
senting” life he is obligated to approximate the “truth ” He attempts 
to get a “true” feeling for the life of the group, the community, the 
nation in the peiiod under consideration 

In the third place, a necessary measure of one's success in represen¬ 
tation 18 the degree to which he conveys a message to an audience, the 
degree to which he portrays to others a corresponding feeling for the 
life which is being depicted This is the very essence of representative 



254 


The Journal of Educational Psychology 


art. That it is essential to the sound carrying on of the education of 
youth IS clear Scholarlyj technically sound, repiesentative art must 
occupy a gio-wing sphere of influence m our progressive schools 

Bui impeiatively essential ns it is, lepresentative art must not be 
confused with creative art m which the individual’s objective poitrayal 
is not controlled by the desire to leproduce either current oi earlier 
forms and conditiona of life. The outline which \vc have already given 
of the representative process of the creative process show clearly the 
likeness of the former to pioblcm-solving and the clear distinctions of 
the^latter 

Two conclusions of crucial importance are possible as a icsult of this 
discussion: representative art and creative art are two different 

things; second, both are necessary in oui schools Representative 
ait will supply ft orucmlly needed moans of artistic expression m 
build mg a clear understanding of our changing society Creative art is 
indispensable to the complete development of the cultured man 



TETRAB-DIFFEKENCES FOR VimBAL SUBTESTS* 
WfLLIAM STEPrrRNSOK 
Univtiaifcy College, London Umvoisily 
Introduction 

A group testf of “vorbaV' sublests was applied by tlie author to 
1037 girls, followed on the noxt clay (per testing group) by a gioup test 
of “non-verba]^’ subtests The latter lias leceived attention in a 
pievious paper.’ Tire purpose of the present paper is to deteimme 
what we can of the faetor-eharactenstics of the verbal subtests, 
relative to the veibal subfcesta themaelvcs. Data will be gathered con¬ 
cerning the satisfaction of the Theoiy of Two Additive Factoj'S by 
veibal material. Further consideiation must needs be given to enor 
other than sampling m tlie totrad-differcnccBi As we suggested m the 
previous aiticle,’ sampling is likely to be only one of many souiees of 
eiror For small populations sampling orror is large m comparison 
with most other sources of eiior lu tetrads that we have knowledge of 
But while sampling erroi is diminished by increase of population, we 
may have no such control for other errors: Errois insignificant (relative 
to sampling) for small populations must needs become more and more 
observable as sampling eiior is diminished. Thus, contempoi^ineously 
with examination of material in terms of the Theory of Two Factors, 
we must give consideration to error other than sampling, and knowl¬ 
edge of such eriors is one of the objects of our woik 

The Verbal Subtests 

The verbal group tost consisted of eight subtests, named “verbal” 
because the test-units made use of pimtcd woids, phiases, or sentences 
or paragraphs Samples of the subtest test-units follow, each test- 
unit showing coriGci lesponses Each subtest will be known hereafter 
by its numbei 1, 2, etc. 

fivUesl 1 —SyiioiiyiTis (mvcntivo^ (Responses in italics ) 

1 tull high 

2 sharp quick 

Silliest 2.—Sentence completion 

1 Birds build their neats m Spimg 

■'‘The authoi is gieatly indebted to Profcssoi C Spearman, iiridei whom the 
wotk reported lieie was accomplished 

^Journal of Educalionat Psydiologjf, March, 1931 
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Siihtesl 3 —Ckssifioalioii 

1 cap stocking coat (toffeo giil wear scarf nut) 

2 dog cow elepHant (brick pmt kitien coal tin) 

Sublesl 4 —Interchanged words 

1 greenliousca aie grown m tomatoes 

2. The dark had long giil hair. 

(Sukesi 6 —OppoaitoB. 

1 come hll go ten 

2 every success onoo failuic 
SuWst 6 —Analogies. 

1 cnt:kitten .dog* (horse puppy foal mice catkin) 

iSwtfgai 7. —Always has 

1. A man always has a (oigai body wife money head) 

2 A bird always has (cage seed wings nests logs) 

Suhtest 8 —Following directions 

1 ’Write the first letter of the alphabet ( A ) 

o 

2. Put nn "x ’’ under an "o” m tlie answer space ( x ) 

Bach, subtest occupied one side of a sheet of paper, quarto size. 
The material, was typewritton-cyolostyled, print being high 

(small letters) The stapled sheets were given to the testees with 
BUbtest No 1 showing, and the 'vaiioiiB matters of test routine were 
gone through with subtest No 1 as a sample. Each subtest was pref¬ 
aced by a set of six test-units displayed and worked through on the 
classroom blackboard, the teat-units being printed and spaced as in tlio 
paiticular subtest. 


Table I 


Subtrst 

Number 
of test- 
umts 

Time 

allowed 

in 

minutes 

Mean of 
cmdo 
scores 

Sigma of 
crude 
8eore& 

1 Synouyma , . , ... i 

20 

2H 1 

8 86 

3 00 

2. Sentonoo completion . . 

26 

4 1 


i 3 60 

3 Classification ■ . 

24 

2H 

7 83 

3 22 

4. latorclianged words 

20 

3 

6 36 

2 33 

6. Opposites , 

26 

3 

8 32 

3 ]8 

6. Analagies. 

26 

2H 

7 65 

d 00 

7. Always has , 

26 

3 

0 54 

3 24 

8 Direotione. 

14 

3M 

5 00 

1 72 
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The subtests in order of application, lime allowances, number of 
test-units, and crude scores and sigmas, aie givon in Table I. The 
whole gioup test took forty minutes for complete application 

lNa'ERCOTmEnATION& AWD TETRAD-niPPERENCES 

Crude Scores .—Iiiterconelations for subtests 1 to 8, with age, 
arc given in Table II. The difference formula for ? was used, for crude 
scores The correlations aie a result of checkings, both in the normal 
couise, and at the instigation of the tetrad-diffciences themselves. 
We examine the correlations in teims of the Spcaiman Theory of Two 


T-IULB II—PJIODUCT-MOMBNT C 0 RRBI.ATION 8 POU 1037 Giuls, Grcdb SconES, 

VnnsAii Sdbtbsib 


Age 

■ 

2 

3 

4 

D 

0 

' 7 

8 


B 

0047 


-0018 


-0018 

-0686 

0321 

1 

HH 

6408 


4289 

1 5151 

1 4408 

5680 

0110 

2 




5001 


6770 

5897 

5799 

3 

■ 


■BH 

, 4701 

5871 1 

1 6524 

1 5724 

6235 

4 



^^B 


4556 

5049 

6010 

514 

5 






5174 

6654 

6240 

6 

■ 


^^B 




6600 

5014 

7 








5859 

8 

B 


H 







Additive Factors The influence of age is neglected for the present; 
Compared with other disturbances to be considered, age eft’eoi is but 
slight Table 11 provides the following teti'ad data. 

Mean of 210 tctrocl-diffeieiMies , 0 0323 

Conventional obseived pe (Mean X 0 8453) 0 0273 

Thcoretwal PE (IQA®) 0 0104 

We thus find erioi in the letiads, ovei and above that attributable 
to sampling 

The tetrads involving subtest No 1 have obseiwed pe of amount 
0 0363, and supply some of the laigcst of the 210 tetrad-differences. 
This subtest was introduced as a "shock-absoibei," and was in view 
of the girls during the pieliminary explanations of testing loutmc— 
It is piobably potent os a distuibei of tetrads because of a bias for 
“speed ” It seems that we cannot lake liberties of the kind granted 
to subtest No 1, without having disturbances losulting m tetrads 
which involve the subtost In the circumstances it is peihaps legili- 









258 


The Journal of ISd-ucaltonal Psychology 


mate to omit suttest No 1 from all further deliberations and this, m 
any ease, is the procedure adopted: Its retention would not greatly 
effect the data obtained from consideration of the remaining seven 
subtests. The latter, subtests 2 lo 8, provide 105 tetrad-differences: 


Mean of 106 tctiiid-difteronccs . , . 0 0229 

Observed po (Mean X 0 8463) ,, 0 0194 

Observed sigma (0,0745 ‘\/SiVb)* 0 0187 

Theoretical PE npproxwnfttuily . . . , 0 0104 


* Wheio i stands for totrad-difTeience, » thou number 

We note erroi of amount about 0.015 in excess of that that can be 
attnbuted to sampling. 

Standard ^‘Normal” Scores ,—Following the procedure already used 
for the non-verbal subtestg, the crude scores used for the corielations 
of Tabic II were converted to the standard “noimar' scores given 
previously ^ Subtost No 1 was not rescaled. After rescaling, all the 
subtests have the same ^‘normal'^ distribution of scores The new 


Table III, —Pkoddct-moment CounBLATiONa j-oii 1037 Giklb Standaiid 
“Nokmal" 8corbs; Vdrbal .Suhtests 



2 

3 

4 

5 

6 

n 

8 

1 

2 

m 


6680 

5085 


6845 

5883 

3 



4023 

5024 


6600 

5100 

4 




4474 


5019 

6040 

r> 






5746 

5121 

6 




i 


5097 

5220 

7 







5929 

8 

■ 








correlations for subteats 2 to 8 so i*escaled are given in Table III, age 
being neglected. The mean mtercorrelation is now 0 5124, compared 
with 0.5456 for the corresponding i’s of Table II Table III provides 
the following data: 


Mean of 105 tetrad-diffcioncos 

0 0249 

Obscived pe (Mean X 0 8453) 

0 0211 

Obaerved sigma (0 0746'\/St*/H)* 

0 0202 

Thoorotioal PE approximately, 

0 0104 


*Whcio l Btnnda for tetrad-diflForonce, n their luimbci 

It is apparent, then, that the I'escaling has not freed the table of 
the excess error observed for Table II Our immediate object is 
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to search for acceptable disturbances m these tetrads Throughout 
we shall make use of Table III, the conelationa being there free from 
scaling anomalies 

CONSIDEEATION OF THE RbSIDUAL EuROR 

Ago IS of but slight effect on the tetiads and, from our experience 
with the non-verbal aubtests, we take the correlational calculations 
to be too accurate to allow of calculational mistakes being suggested 
as an explanation of the error obtained for the tetrads of Table III 
What has been said in a previous paper^ concerning calculation mis¬ 
takes holds equally well here: There must be some error attributable to 
calculational mistakes, but we take it to be slight; and the various 
correlations should be relied upon even if it is found that the tetrad- 
differences are slightly inaccurate, because the correlations receive 
most attention. The calculations for Table II were quite different, 
from beginning to end, from those for Tabic III: The crude scalings 
were satisfactory approximate ^'normal” distributions, so that the 
correlations for Table II should differ but little from those for Table 
III As we see, the correlations are in fact but little different. Such 
considerations, and similar details to be observed m the course of our 
work, together with the help provided by insUtutmg reoheokinga of 
calculations at the investigation of the tetrads themselves (a correlation 
associated with large tetrad-differences is first suspected of cal- 
eulational mistakes, and recheokmg is made for that correlation), tend 
to verify our acceptance of the various correlations as being reasonably 
free from calculational mistakes 

We can isolate no single specificahty in the case of Table III (or 11), 
i.e., none showing uniquely, as m the case of the ?'n,viir correlation or 
the non-verbal subtests.^ We therefore proceed to examine Table III 
in the light of influences already known lo us, so that, by eliminating 
some, a limited number may be left for final consideration 

Stmtlanly of Relahons —The Classification, Opposites, and Anal¬ 
ogy subtests (3, 5, and 6 respectively) involve very similar “likeness,” 
or “unlikeness, ” eduction—^the classification test-uniLs can be answered 
in terms of “not-similai,” oi “opposite,” the analogy test-units 
involve both “opposites” and “similoi's," while the opposites test- 
units likewise sometimes may imply “similars ” Thus, foi example, 
the analogy test-unit is constructed of “oppositos” m the following 
sample: 
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Now these three siibtests have been found by Bavey^ to entail specif- 
leality which, not unreasonably, was attributed to too great similanty 
of the relations involved in the teat-units. It is probably, then, that 
the same effect enters into oui sublcsts We can free our data of such 
an effect by omitting all tetrads involving ras, rao, and jea, leaving for 
consideration tlie tetrads that cannot bo disturbed by Iho piobable 
specificahty The process leaves 57 tetrads, with observed pe (con¬ 
ventional, , observed mean X 0.8463) of value 0 0181, the 

theoretical PE being approximately 0 0104 Hence, even were spccif- 
icality acceptable for these correlations, the residual error for Table HI 
is just slightly leduced by eliminating the distinbance 

“Idiosyncrasies ”—Of other possible distuibers of toUads pievioug 
mention has been made of Irat-constiuctor^s idiosynciasics ‘‘ Thus, a 
battery of Thorndike CAYD subtosls compared (by means of the 
tetrad technique) with, aay, SpeaimoJi oral subtests, shows specificality 
m the one set of subtests lelative to the other.® The Bpecihcality may 
be due to the fact that the Spcai'man test-units aic oially presented; 
or to scholastic influences m the Thorndike test-units (showing in 
Arithmetic, Word-ability, XJnderstandmg of paragiaphs, etc); or, 
indeed, to both 01 othei influences. 

Now of the verbal subtests in Tabic HI, Nos 2 and 6 weie largely 
Thorndike GAVD test-unita (acntenee-completion and opposites), 
while the olheis were of my own construction (although following well- 
known patterns) The tetrads for the five subtests of iny construc¬ 
tion (3, 4, 6, 7, and 8) have value as follows: 

Mean of 16 tetincl-clifferonces , . 0 0148 

Mean X 0 8453 (obsCivedpo) , 0 0125 

TJicoietical PE appvaximatelv 0 0106 

It is of mtcre&t to note that the laigcst tetrads among these 16 
are associated with the con-elalion (consideied above); Omission of 
rsa gives 9 tetrads with value. 

Mean of 9 teU'atl-difteYencc& . 0 0131 

Mean X 0 8453 (obscivod pc) 0 0111 

ThcoioticalPEappioximatoly . , 0 0105 

(If the compaiable con'elations for ciucle scores are considered 
the tetrads still show eiior of amount 0 016 when ?jo is omitted: So 
that if we accept the calculations, eiioi of amount 0 015 appeais to 
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arise from scaling anomalies, a result in accordance with conclusions 
drawn m the previous paper, 

The subtests 2 and 5 may be disturbed by difficult or unfamiliar 
words; subtests 3, 6, 7, and 8 contain only what must be taken to be 
familiar words witli “concrete” mcanmg (see the various samples 
already given) and verbal aubtests less mflueiiocd by critical word- 
ability could scarcely be constructed Subtest 4 involves somewhat 
complex sentences, with abstract structure. 

The omission of tetrads involving ras would free the tetrads for 
Table III of any influence characterising these two subtests alone 
But residual error of amount 0 019 remains if ras alone is omitted from 
the tetrads for Table III, and if, in addition, we omit tetrads involving 
Tas, I'u, and rso, so making allowance for possible “similarity of rela¬ 
tions, ” this residual error becomes 0.018 (over and above sampling 
error) Thus idiosyncrasy for subtests 2 and 5 provides no obvious 
specificahty relative to the other subtests. 

The author's work with various group tests—such as the Otis, 
Spearman, National, Thorndike, etc—^has shown the potency of 
influences entailed in different test-units constructed by one and the 
same psychologistAbove, we suggest, is an example of the same 
phenomenon. Had the author constructed the eight verbal subtests 
himself, (m passing we note that subtest No. 1 waa taken from work by 
Slocombe®) he is of opinion that the eight might have shown agreement 
with the tetrad criterion as satisfactory as that shown by 3, 4, 6, 7, and 
8. Subtests 2 and 5, acting as “reference values,” show that dis¬ 
turbances are latent m the five subtests 

Speed Pi eference ”—An example of speed preference is given in the 
previous paper,^ for subtests 11 and VIII We found that the effect 
could be controlled in terms of the eirois made in subtest VIII 

Subtests 2, 4, and 8 (and 1) weie free from errors Each test-unit 
was either fully coriect or not attempted Subtests 3, 5, 6, and 7, 
show frequent errors Sheer guessing, the scoies indicated, was rare, 
We judge mtiospectively, and from the prevalence of mistakes made 
by the testees, that subtests 3, 6, and 7, are most likely to entail a 
"speed” effect Subteat 5 is oslcnsibly similar to 3, 6, and 7, and may 
be judged to entail “speed preference”, but the test-units in aubtest 5 
have qualities that do not lend themselves to “speed preference ” 
Furthermore, rz6 and ree have received piior notice in terms of similar¬ 
ity of relations, and the inclusion of these correlations in the tetrads 
about to be considered la open to criticism on that account The 
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influence of "speed” will be most noticeable in tetrads of tlie type 

(s stands for a subtest involving "speed pi'efercncc, ” such as 3, 6 , and 
7 ; and g for a subtest taken io be satisfactory for the speed-quality 
functioning) 

There rig 36 such tetrads for the s suble&ts 3, 6 , 7, and 5, taken 
together with the q Bubteets 2, 4, and 8 These have obBerved pe 
0.028—quite a significant result Omitting these 36 tetrads from the 
full 105 for Table III leaves 69 tetiads, with value 

Mean of 60 tetrad-diffeicnces. , 0 0200 

Mean X 0 8453 (conventional pc) . 0 0174 

Theorelicnl PE approximately. . 0 0106 

Blit if subtest 5 is not taken to be “speed” biased or, if prior regard 
IS taken of the similarity of relatione noted for rn and res (and probably 
ras), then the mean of 18 tetrads of form (1) for 5 subteata 3, 6 , 7, 
and q subtesta 2, 4, 8 , is 0 024: And clnnmation of these loaves the 
tetrads for Table III undimmished We see, then, veiy little clear 
evidence that "speed preference” has entered significantly in our 
subtests, judged, that is, among themselves. The evidence, of course, 
might be otherwise if different "leferoncc values” aie employed. 

Propinquity" Influences ,—These influences may bo attiibuted to 
objective or subjective fatigue (espcmlly when the testing time is 
lengthy, taking two hours or so) as “habituation,” and as "end-apurt.” 
Calculation mistakes may be suspected too, especially in which 
IS usually the first correlation calculated The influences show in 
tetrads of the type: 

ri2 ■ Tib - n? ns = / 

Control of such influences was attempted m our work. Subtest 1 
has been omitted from calculations partly because it served as an 
"habituation,” or "shock,” absorber, the testing time was reasonably 
short; aubtest 7 was quite unlike subtest 8 in routine requirements, so 
tending to break any " set” towaid cxiia effort m the last two subtests; 
every endeavour was made to dispel initial indifferenco, apprehension, 
or "speed preference.” 

The observed conventional pe of all tetrads involving r^e is 0 0244. 
But the largest of these tetrads have and ? so likewise on the left- 
hand side of the above type of equations, and omission of tetrads 
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involving these corielations leaves 16 tetrads, now with pe 0.0205. 
Omission of all tetrads involving i jsj» sb, and r6«, leaves 51 for Table III^ 
■with pe 0 0168 However, what little evidence may be got from these 
results for > n is offset by the fact that no disturbance is apparent for 
?78 when the autlior’a subtests alone are congideied (sec section on 
Idiosytwasics) The data thus give no indication of disturbances 
attributable to propinquity effects 

The Iv^uence of Testing by Gioit-ps —This has been suggested by 
Professor Spearman* as a likely source of error in tetiads In the case 
of tile present verbal material a check of the influence can be made by 
calculating separate correlations for each group of girls tested, averag¬ 
ing the coirelations so obtained For our 1037 girls we had 21 testing 
groups. The calculation mistakes entailed m working out such a 
large number of corielations might outweigh the eiror to be expected 
as attiibutable to gioup testing It is possible that, by calculating 
separate correlations foi each testing gioup, we might arrive at mter- 
correlationa giving sampling error values to the tetrads for Table HI. 
But we would bo concerned with the slight specificalities under con¬ 
sideration for Tabic III, tho whole being relative to the verbal subtests 
themselves 

We noto that no error need be (nor can be) attributed to group 
testing anomalies in the case of the non-verbal subtests' And the 
largest error available in the case of the verbal subtests can be of the 
Older 0 016 only In tho case of the five subtests constructed by 
the author, 3, 4, 6, 7, and 8, there need be no error attributable to 
group testing anomalies. 

But there can be no doubt that gioup testing, on occasion, may 
introduce large disturbances m tetrads Thus, correlations may be 
much influenced if one class, having been taught geometry, is given a 
test involving geometry, while other classes, given the same test, have 
received no such instiuction in geometry. It may be taken, we 
suggest, that our non-verbal subtests would bo most open to influences 
of this kind (consider, for instance, the subtests III, VI, and VIII as 
given m the previous article’^) Except m terms of vocabulary 
instruction, such influences cannot leadily be taken to enter the verbal 
subtests Previous practice with similai' subtests would not cause 
distuibances in the tetrads, if oil the subtests received the practice, 
or, m effect, received the practice Group testing may introduce 
disturbances in other ways; for example by mistakes in timing subtests, 
or through faults in testing technique for particular subtests foi some 
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testing groups. All the testing wag done by the author, and sugges¬ 
tions of timing or test application or marking faults can be 
discountenanced. 

A procpdiire to be described in the next sPcLion might be cvpeeted 
to negate broad influences that may anae because of group testing' 
The pYOcedurc leads to no material diminution of the cvrov m the 
tetrads for Table III. 

The Influence of School and Class —Aa has been reported in the 
previous paper,’ the girls for our work were drawn from eleven schools, 
and from Standards IVA to VIIB in those schools (see Table IP), 
Certain schools were by repute of bettor standing than others AVe 
could determine intercorrelations for the sublests and leputed school 
standing Similarly, a point scale could be made for school standard. 
The influence of school and school standard could then be partialled 
out Instead of making two sots of corielations necessary, our 
purpose can be served by combining both reputed standing and school 
standard (class) into ono mcasuie. A 16-point scale was devised 
(hereafter called the C-measuro), the foundation being the order of 
class (LVA to VIIB) within which girls of classes with high reputation 
were accommodated The various Standaids IV were scaled 0, 1, 2 
etc,, where the reputed “poorest” school was scaled 0. The score 
was the same for every girl in a particular class*. And it depended upon 
opinion given by teachers, upon scholaislup returns, and, objectively, 
upon the school class, We believe the C-measuro to be a satisfactory 
men,sure of the relative schooling and environmental influcnees 
exerted on the girls 

To Table III we can now add the following coi relations of the 
subtests 2 to 8 with the G-measure 0 4598, 0.4291, 0.3130 , 0 3669, 
0.4163, 0.4451, 0,4110, respectively. 

The partial correlations, for the C-moasuie paiUalled out were 
next calculated, and the coirelations provided tetrads with the follow¬ 
ing value; 

Mean of 106 totiad-cUlTeioncea, Table III, with C-mcasuro 
paitmlled out., , 0 02C3 

Obaei'ved po (Mean X 0 8453) . . 0 0214 

Theoretical PE approximately . , 0 0106 

yurthevmore, wo can try out all the various possible mlluonces 
discussed in the previous sections, using the paitial correlations 
instead of those given m Table III In all oases the conclusions 
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arrived at aie in no way diJTorent from those aruved at for Table III 
The disposition of error in the tetrads still shows rac and rsa as sonrees 
of large diffeicnces; a try out of the theory of “speed preferences” 
gives much the same results; and the five siibtesta constructed by the 
author again have good agreement with the tetrad ciiterioii. Thus, 
It 18 not in terms of a C-measurc that residual error m the tetrads for 
the verbal aubtests can be explained. 

The Influence of “VerbahUj **—Ostensible characteristics of the 
verbal subtests are as follows 

(«) Siibtesta 2, 4, and involve phiosos iind scntcncea or ahoit pnragiaplia. 
(6) SvvbtGst 5 (tvud 1 U> ft Ic'iBCi clogiec) cirtioally entails difftcuH words—for 
instance, test-units of this t 3 'pe, 

"airy uniform blithe divcisificd’' 

(c) Subtests 3, 6 , and 7, make use of simple woids, all well within easy undei' 
standing of the girls tested (t e , according to thoiv p-nbility — ive do not suggest 
that the dullest giil tested bad knowledge of all tlie woids in these subteats) 
(It is this easiness of 'vocabulary, and simplicity of tJie relations involved, that 
makes subteats 3, 0, and 7 particularly open to ‘'speed’* influences ) 

id) Subtest 8 also involves easy woids, equally understandable by the gnla, 
but we cannot readily take it to be '‘speed" biased 

(e) Subteats 2 and 4 aio not so critical for vocabulary as is subtest 6 Sub¬ 
tests 2 and 4, howovor, arc supeificiolly much alike—both arc essentially “sen¬ 
tence completion " 

(/) A generalization fiom influonces of the kind just passed in review ((a) 
to (c)) is got in. terms of the fact Hint foi any given fundaments—qf worde, or 
phinsoa, or othei hngiustio stritcfciiio — a onlicnl inattei may bo (1) either that the 
word 01 phinae, etc has to lecall meaning, oi ( 2 ) that meaning (alicady eduoed) 
has to recall woids or phrnses, otc Thus, leproduchon, recall of a word or pinnae 
or incaiuiig, may be ontienl in some test-units But, education, not reproduction, 
clmincteiizes the universal 0 -factor, and cnticnl repioduction may thus possibly 
act as a chatuibor of tetinds 

What, then, 1ms our data to offer concerning the above character¬ 
istics and influences? Obviously it will be of gieatest value to refer 
the verbal material to the non-verbal subtests, keeping in mind the 
above possible influences This, however, is to be our concern later 
For the present wo note the following facts 

Tetrads of type (1) for s as subtoste 3, 6, and 7 (taken two at a 
time) and q as subtests 2, 4, 5, and 8 (two at a time), have observed 
conventional pe 0.0201, while the observed pe for ail the other tetrads 
of the table is 0 0216 If we allow for disturbances attributed 
to “similarity of relations” the obseivcd pe for tetrads of type (1) 
becomes 0 0174, compared with 0,0178 foJ the rest of the tetrads of 
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the table There is no evidence, Ihon, for sjDCCificality m sublests 
2, 4, 5, and 8, relative to 3, 6, and 7, i e,, nothing is obseived of the 
nature of a “speed preference” foi subtests 3, 6, and 7, and nothing m 
terms of “verbal ability” in subtests 2, 4,5, and 8 (for difficult vocabu¬ 
lary and understanding of connected discourse). This conclusion, of 
couise, IS relative to the verbal subtests amongst themselves. The 
results do not seem to piomise assistance by offering explanations of 
the excess error obtained in the tetrads for Table III. 

In terms of the verba! nubtests alone, it would bo making too 
much of our material to enter into the possible influences of reprodiic- 
tion on the tetrads. Sliould a sufficiently broad spocifioality be 
observed m the verbal subtests relative to the non-verbal subtests, 
which receives no acceptable explanation in toims of influences such 
as those of “speed preference,” "idiOByncrasies,” "group testing,” 
and the like, then a most impoitant source of disLiirbances of tetrads 
might well be reprodvclion effects All this, however, is a matter for 
future considemtion. 


R^SUSi^ AND CONCTjUSlONB 

We have applied the Theory of Two Factors to the intercorrelations 
for Table III, and find that the obseived error in the tetrads is slightly 
in excess of that expected from sampling cnor alone 

Previous work confined to verbal subtests has shown some agree¬ 
ment with the tctrad-diffcixsnee ciiicnon, but most of the previous data 
are for small populations only, wheie the sampling error is large m 
comparison with other errors, so swamping them. When, however, 
the sampling error is small (ns m our work) some observed excess 
error, of the kind that wo have found, is to bo anticipated and, indeed, 
18 demanded by the Theory of Two Factois The observed excess 
error for Table III, then, is not incompatible with the Theory But 
the elimination of such small excess enors would only .slightly reduce 
the ( 7 -saturation of the correlations. 

Our problem has been that of seeking acceptable explanations for 
the excess observed cnor in the tetrads for Table III We have 
applied to our data certain thcoiics of disturbances of tetrads that have 
been found of explanatory value in previous work, trying, in particular, 
the influences of ago effects, calculation mwtakes, "speed prcfcicnccs,” 
“propinquity,” tester’s idiosyncrasies, school and class, gioup testing 
anomalies, and ^'similarity of relations.” Of the various suggested 
disturbers of tetrads, that of "similarity of relations” for the Analogy, 
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Opposites, and Classification subtests appears to be the most dis¬ 
cernible, but it is not at the root of the major part of the observed 
excess error. Speed preference," age, school and class, and superficial 
verbal likenesses of the subtests, give no clear indication of being 
appreciably contributory to the excess eiior. We are in some doubt 
about the magnitude of error attributable to group testing anomalies. 
Error is perhaps likely, but the non-verbal subtests’ gave no indication 
of being so influenced, and it is perhaps among these subtests that 
we might most expect such group testing effects to be disturbers of 
tetrads. We find, then, that none of these suggested probable dis¬ 
turbers singly can be taken to account fully foi the observed excess 
error m the tetrads for Table III. The sources of error so far brought 
forward appear to be inadequate to explain the whole of the excess 
error 

We might accept, piovisionally, a theory that a sum of many 
small disturbances of the kind passed m view m the course of our 
papei may be taken to explain the observed excess error. This 
would mean that elimination of all the suggested small disturbances 
would but slightly leducc the (/-saturation of the coiielations. For 
further light on this matter, however, we must look to comparison of 
the verbal and non-verbal subtests, a study that we are to repoit in the 
next papoi. 
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FOUR TYPES OF ]iiXA.MINATIONS COIVCPAIIED AND 

EA^ALTJATED 

ALVIN c fiuiircir 

Uiiivoi’sity of Aliimphota 

Since objective examinations me used so oxlonsivcly to measure 
flchievement in college courses, it may no longer be necessary to refer 
lo them as now-type oxarainationa. This docs not imply that auoh 
measures of accomplishment are fully evaluated nor does it oven 
suggest that diligent scrutiny of then icsuUs has become anachronistic. 
In fact the greatei use of these examinations makes imperative even 
more extended studies of their relative validity and reliability as well 
as the inter-relationship that exists between them. Such investiga¬ 
tions should be conducted m a rather wide vaiicty of specialized 
courses now taught in colleges and uaivcisitics. The well-known 
work of Wood^ at Columbia University has done much to stimulate 
a widespread interest in evaluating various types of achievement 
examinations that arc now in vogue. The particular investigation 
reported withm these pages is an outgrowth of that interest. Its 
purpose is Lo evaluate the essay, completion, multiple-choice, and true- 
false examinations when each type covers exactly the same subjoct- 
mattor. 

Mkthod 

As far as can be determined the unique fcatinc of this investigation 
rests in the method employed lo evaluate the particular types of 
examinations used. In constructing the tests a traditional essay-type 
examination was first prcpaixid to cover the salient points of the 
subject-matter Following the formulation of the questions the 
answers were written out in detail and the total iiumbei of items to bo 
included in each question was thereby determined The next step 
m the procedure was to construct a completion examination covering 
exactly the same material as that embodied in the essay type. To be 
assured of this, the completion sLatemeuts wore made up from the 
answers to the essay questions. A multiplc-choico examination was 
next constructed in the same manner; and following this, a true-false 
exammation. Thus the completion, multiple-choice, and true-false 

^Woocl, Ben D . "Moaaurcinent in Higher Education " Woitd Book Co j 
1923 
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tests were each derived from the correct responses to the essay-type 
questions. 

This procedure was followed in two experiments at the Univerbity 
of Minnesota. 

The first of these was conducted with a group of students enrolled 
in a covnsc in statistical methods during the first term of the summer 
session of 1927 In the class, theio woie one hundred seven seniors 
and graduate students of the College of Education, ninety-nine of 
whom weic present on the day the tests were administered. 

In the second experiment, the group consisted of one hundred six 
juniors and seniors enrolled in educational psychology during the first 
term of the summer session of 1929 

In both cases the only knowledge which the membcis of the class 
had concerning the experiment was that they were to take a two-hour 
midterm examination They were told that this examination was to 
coneist of four parts. Part I, an essay examination, Part II, a comple¬ 
tion examination, Part III, a multiple-choice examination; and Part 
IV, a true-false examination They wcie further informed that the 
examination would covoi all the matciial in the couise up to the middle 
of the term. 

The total numbci of points in each type of test and the amount 
of testing time allotted arc included in Table I for the first experiment 
and Table II for the second The examinations used m Experiment 
II were somewhat longei than those in Experiment I although the 
amount of time allotted to each was greater only in the case of the 
true-false test The experience vnth the first investigation served 
as a basis for this adjustment. The teats are listed m the tables in 
the same order as they were given. 


Table I—Testing Time, Total Points, Means, and Varubiliti of Scores 
ON Four Types op Tests Used in Experiment I V = 99 


Test 

Testing 
tunc in 

min¬ 

utes 

Total 

points 

Range 

ot 

scores 

Menu 

PE 

HD 

PE 

cv 

Essay 

35 

69 

20- 61 

S9 27 

+ 

62 

9 14 

± 

44 

23 27 

Completion 

30 

94 

25- 78 

49 16 


78 

11 44 

± 

56 

23 27 

Molbiple-olioice 

20 

39 

11- 38 

29 41 

± 

33 

EKQ 

± 

24 

16 70 

True-false 

15 

60 

28- 46 


+ 

23 

3 34 

± 

m 

8 49 

CompositG offoiii test? 

100 

252 

109-217 

154 89 

±1 

57 


±1 

11 

14 98 
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The scoring of the essay test was somewhat more objective than 
IS usually the case Each afcudenVs paper was compared with the 
complete set of answoiB previously worked out, and only those points 
which appeared on the master copy were given oredit For the comple¬ 
tion and multiple-choice oxaiiunations, the number of correct responses 
was ooneidcred as the score On the true-false teat the score was 
determined by subtracting the number of wrong responses from the 
number right 


Tablk II— Testing Timd, Total Pointb, Mbama and Vaui^vdility op Scores 
ON Fonn Typeb op Tests Used in Expemment II iV = 106 


Teat 

TcatJng 
time m 

min¬ 

utes 

Total 

points 

Itniigc 

of 

scores 

Mean 

PE 

8D 

PE 

CV 

Essay 

35 

L18 




80 

12 ID 

± 


29 78 

Completion 

30 

06 

16- 70 

55 28 

i 

84 


± 


23 34 

Multiple-choice 

20 

GO 


d8 ‘14 

± 

48 

7 35 

± 

34 

16 17 

True-falso , , 

20 

75 


39 25 

± 

76 

>0^ 

± 

53 

29 04 

CorapoBito of four tests 

105 

358 

02-258 

171 33 

±2 

37 

■ 

IIO^ 

mil 

21 13 


Results 

In the first experiment the four testa varied in their diffeTentiating 
capacity as shown in Table I. An examination of the figures in the 
appropriate coKimn reveals the fact that the standard deviations on 
the essay and completion tests are larger than on the multiple-choice 
and true-false examinations. The same is true of the coefficients of 
variability This difference is without question clue to the nature of 
the particular examinations used rather than due to the type of test. 
The variability measuies for Experiment 11 (Table II) show that the 
essay, completion, and true-false examinations appear to differentiate 
the students to approximately the same extent. Had the multiple 
choice test been made longer it is very probable that it would have 
differentiated the atudonta equally well. 

In order to determine the extent to which the foiu types of tests 
measured the same degree of achievement, their iniercorrclations 
were found The coefficients for both experiments aio given m Table 
III Considering the tests as given in the liist cxpciimont it is evi¬ 
dent that the highest mfcerconelation appears between the multiple- 
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Table III —iNTEUconnELATiONs of Tebts 



E\peritnent I 

Experiment; II 


PE 

Corrected 

for 

flttojni- 

atioii 

r 

PE 


Essay and completion 

44 


02 

80 

± 02 

1 20 

Essay and multiple-choice 

47 

± 05 

07 

m 

± 04 

97 

Essay and true-false 


ISTi 

G6 

55 

± 05 

89 

Completion and multiple-ohoice 

57 

EVk 

80 

71 

± 03 

92 

Completion and true-false 

37 


68 

63 

+ 04 

36 

Multjple-choico nnd tnio-false 

44 


81 

65 

± 04 

90 


choice and true-false types (r = .67) The lowest exists between the 
essay and true-false examinations (r = .30) When corrected for 
attenuation, the multiple-choice test correlates about equally as high 
with the completion (.80) as with the true-false type (.81) In the 
second experiment all the intercoirelations arc higher The coeffi¬ 
cient of greatest magnitude is found for the essay and completion 
tests (80) The lowest correlation obtains between the essay and 
true-false tests (.55) as in. the firaL experiment. When corrected 
for attenuation tho coefficients in Experiment II range fiom 85 to 
1.20 ^ These high coefficients indicate that if a reliable test is con¬ 
structed one type is probably as adequate for measuiing the acquisi¬ 
tion of information in a course as any of the other three types The 
fact that the intercoi relations are lower in the first experiment than 
in the second is probably due to the lower validity and reliability of 
the first set of tests m comparison with the second, although the sub¬ 
ject-matter of the teats may also be a factor. 

To evaluate these facts further, correlation coefficients weie 
calculated for the scores on. each test and composite scores on the other 
three For example, the essay test was correlated with the composite 
score of the multiple-choice, true-false and completion examinations. 
The same procedure was followed for each of the other teats These 
correlations, which may be called validity coefficients, have been 
placed in Table IV. The values for the tests as used in the first 
experiment appeal m the second column as follows: For the essay, .64; 

* A coiTGctod coirolation that is greater than 1 00 must be interpreted to mean 
that the relationship is neai imitv 
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for the completion, 68; for the multiplo-choicc, 66, nnd for the true- 
false, 40, It was further sought to cletcnnmc the viilKlity of the 
tests in case cacli of the foui types was iiindc of equal length; that is, 
in ease the testing time for each was sixty minutes 'rhiis, the validity 

Taulb l\' —Tim Riolition op Bach Typc op Tisst to tiii: Oomj’ositd op the 

0x111311 Tiiu>jk Tivir^ 



11X1)1*01110111 I 

Experiment II 




If inado 



Tf made 

ICGlB 

1 Ah Gonslrnclcd 

Bi«ly rniD' 
•lies m 

j Sb Kjnalnirlocl 

sixty uim- 




length 



Ictiglli 


1 r 

1 I'M 

j r 

1 • 

1 

: in\ 

r 

Essay 

(jd 

i 04 

00 

70 

± 03 

84 

Completion . 

68 

± 04 

73 

82 

J. 02 

,80 

Multiple-choice 

QG • 

± 04 

74 , 

77 

1 03 

84 

Tnie-falae 

Estimated validity of, 

40 

J: 00 

.74 

75 

± 03 

8t 

composite of four i 
tests ' 

70 



80 




coefficients are estimated for the essay test when less than doubled in 
length, for the completion test when doubled, for the muUiplc-choico 
test when tripled, and for the tiuc-falsc test when quadrupled To do 
this tho formula for determining the validity of a lengthened test as 
given by Holzinger^ was u&od. Tho cocflicionts obtained m this 
manner aio as follows* Essay, 69, completion 73, multiple-choice, 
.74; and true-false, .54. 

The validity cocffioienls for the tests used in Experiment 11 were 
likewise calculated These aio also inserted in Table V For the 
essay test as constructed, tho validity coollicicnt is 76, foi the com¬ 
pletion, .82, for the multiple-choice, 77, and for the true-false, 76. 
When estimated for the tests if made of equal length, the cocfficicnls 
are all of approximately the same magnitude They mdicn-te, thcic- 
fore, that the four types of tests used in these expeiimcnts have 
approximately the same validity (providing the critenon is an adequate 
one) The aurpriamg impUcaiion of this fact is that the essay typo of 
examination, when scored objcctivoly, appears to be as valid as the 
other so-called objective examinaliona 

' ITobingei', Kail J. '“Statwtieal Mothoclsfor Htudrals iii Ecluoation ” P 170, 
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The reiiabihly coofficiwila pTcsented in Tabie V Tvere found by 
securing the Pearsonmn r between the odd and even items of the tests 
and estimating with the Spearman-Brown formula. In both of the 
experiments the completion and multiple-choice examinations are 
most reliable In the first, the true-false lost has the lowest reliability 
whereas the essay examination is least reliable m the second. When 
the reliability coefficients are estimated for tests of equal length, the 
completion and miiltiple-choicc types retain their positions as the most 
- reliable tests in both experiments The reliability of the essay exami¬ 
nation m the first experiment does not differ markedly from these 
whereas in the second experiment, the essay examination appears to be 
considerably leas reliable The rohabihty coofRcient for the composite 
of the four tests of each oxpenment was determined by an adaptation 
of Spearman’s formula for the con elation between sums or averages.* 
The coefficients show that the two batteries of tests have approximately 
equal reliability 

'I'ABIiB Y —REMABlum QV TeBTS 


Test* 

Experiment I 

Experiment II 

Aa 

1 confilniotcd 

If mndo Bisty 
minutes in 
longfch 

' Ab 

oonsLniotod 

1 

1 If made sixty 
j minutea in 

1 length 

t 

PE 

r 

1 ^ 1 

r 

Pli! 

1 

r 

1 PE 

Itseay 

00 

1 ± 04 


± 03 

50 

j ± 00 

00 

± 04 

Complotion 

72 

± 04 

84 

± 02 

80 

± 03 

80 

± 02 

I^ultiple ohoioo 

71 

± 04 

88 

± 02 

76 

± 03 

.00 

± 01 

True-fnlso 

41 

± OS 

74 

± 05 

GO 

± 04 

87 

± 02 

Gomposile o{ four testa 

86 




80 





Another matter of concern was the lelationship of these various 
types of examinations to intelligence The only intelligence test scores 
available for the group of students enrolled m statistical methods were 
those on the Miller Mental Ability Test, Form A. The coefficients 
of correlation between this test and the various types of achievement 
examinations appear in Table VI. The zero order coefficients show 
that the highest degree of relationship exists between Miller A test and 
the completion examination (? = 53), the lowest between the Miller A 

^Kelloy, T. L ’ “StatiaUeiU Method" P 1Q8, Douglas, H E and Cozens, 
F. W ' On Formula for lUatiinating tlie Reliability of Tesfc Battciiea Journal of 
Educahonal Psychology^ VoK XX, 1929, pp 389-377 

* Miller, W S “Mental Ability Test" World Book Company 
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and tho essay exammation (r = .33). Wlicii collected for attenuation, 
the cootficients of correlation between Ihc Miller Mental Ability Teat 
with the completion (.08) and wiHi the Iruc-falsc examination (.67) 
are approximately equal, whereas the lowest relationship is found with 
the essay examination. 


TaULE vr -IlBEATIOS OF TkSTH TO iNThT-MOENCR 


SNpcriinoiit I 
Miller Mculal Abihty Teat 


ICxpcrimciit II 
Milloi Ilnrd AiinlogiosTcst 



r 

PE 

Corrected foi 
nttenuntion^ 

r 

PE 

Collected fo 
attenuatwa 

Essay 

33 

i 


43 

34 

+ 

00 

48 

Completion . . 

l>3 

± 

06 


44 

± 

013 

62 

Multiplc-choico 

42 

± 


64 


± 

Of) 

06 

True-false 

40 

± 


67 

.j5 

± 

Km 


Composite of four teats 

40 

± 

06 

57 

63 

1 

Of) 

59 


.90 


* TUe scK toiielatiou for the Miller A la 86, and for live Analogies teat, 


In the educational psychology class tho Miller Hard Analogies 
Tesli was used as a measure of inlolligencc. With this test, which 
IB bettor adapted to the college group than the Miller Mental Abihty 
Test, the lelationship between the essay examination and inlelligence 
is also tho lowest of those obtained It would seem, tliciefoie, that 
students with relatively good intelligence aie leas apt to scouio high 
scores in the essay examination than on the other three This may 
be due to the fact that the foim of the essay type is much less like the 
form of intelhgcuco tests than are the completion, multiple-choice, and 
true-false types. 

After the students completed all four parts of the examination, 
they were asked to write out their order of preference for these types. 
These data are summarized m Table VII for Experiment I and in 
Table A^III for Experiment II. In both classes the multiple-choice 
examination is placed iiist by a larger percentage of students than 
any of the other types. Tho Uuo-Calse is placed second. In the first 
experiment the plurality gives the essay examination the third position 
and the completion examination the fourth In Expoiiment II, 


* Not commercially available Ficpaicd by W. S Millei 
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ho-wever, tho plurality gives the completion the third position and the 
essay, the fourth. It is clear that the multiple-choice and true-false 
examinations aie preferred by the students to the essay and com¬ 
pletion types. 


Tadi.b VII — Student Prepbuencbb fob Dipphrent Types op Tests 

Exporiment 1 


Type of examination 


Choice 

Essay 

Completion | 

1 Multiple-choice' 

Title- false 



! N 

\ 

Per cent 



V 

Per cent 

■mu 

14 

14 0 

6 

6 5 



39 1 

40 6 

KumSmt 

14 

14 9 

6 

6.4 

34 


39 

40 6 


44 

46 8 

22 , 

23 9 

16 


11 

11 6 

P QlMMil 

22 

23.4 1 

69 1 

04 1 

4 

43 

mm 

7 3 

Totals 

94 

100 0 

92 

09 9 1 

93 



100 0 


Table VIII — Student Prefbbbncbs fob Dipfbbent Types op Tests 

Ebtperiment II 


Typo of examination 


Choice 

Essay 

Completion 

j MiiUiple-choice 

Tiue-falso 

N ' 

Per cent 

N ' 

m 



iV ' 

1 

Per cent 

First 

11 

i 11 5 

13 

13 4 

58 


1 

' 18 4 

Second 



10 

16 5 

27 

’ 27 8 

44 

44 9 

Third 

27 

28 1 

38 

39 2 

g 

9 3 

22 

22 5 

Fourth 

49 ' 

61 0 ' 

30 

30 0 

3 

3 1 

1 14 

14 3 

Totals 

96 

100 0 

07 

100 0 

97 


' 98 

100 1 


further analysis was made of these data by tabulating the oider 
of preference for the fifteen individuals securing the highest score and 
for the fifteen securing the lowest score on the intelligence tests 
Table IX. presents the figures for these selected groups in the statistical 
methods class while Tabic X presents comparable data from the 
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second expenmont Although no generalizations can bo derived 
from these two tables, it appears that both Lhosc of low and high 
intelligence prefer the multiple-choice and true-false tests more tlmn 
they do the other types. In the first cxporiinent Ihoie is u tondoncy 

Taiji/I: IX,— Test PiiEFtm-iffCBB fou ’riiu Piftbun IlmnEHr Ranking Stcdhnth 
AND Fon TUB Fifteen Lowest Uanmno Htuounts in iNTEUiiODNCU 

K\))oi mien (> I 


Type of oxaininaium 


Choice 

Essay 

1 Complolion | 

I MvilUjilc-choice j 

1 True-taUc 


1 Highest 

1 Lowcefc 

1 

, High cat 

Lowest 

nigl3GStjL0W("iL 

IIiglirHl 

Lowosi 

First, 

I 0 

1 ^ 

1 

0 

7 

4 

7 

6 

Socoiul 

t 3 

1 2 

2 

0 

6 

0 j 

4 

7 

Tlmd 



i 

3 1 

2 

■1 1 

2 

l 

Fouith 

6 


8 

12 

0 

1 

2 

1 

Totals 

16 


15 

15 

16 

16 

1,6 

16 


Tabeb X—Prefeubnceb pou the Fifteen Hioiiest ILanxino Ktudi^nth. 
AND FOn THE FlET’BBN LOWEST liANKlNO iSTUnENTS IN InTEDI.IOIJNO’E 

libcpciimcnt 11 


Type of examination 


Choice 

Essay 

1 Completion | 

MnUiplt'-ehoKjf' 

Tiue-falHO 


Highest 

Lowest 

Highest 

Lowest 

Highest 

Lowest 

Highest. 

Lowest 

First 

3 

3 

1 1 

0 

10 

7 

1 

f) 

Second 

2 

i 2 

i 3 

1 

2 

6 

1 ^ 

7 

Third 

2 

' 4 


■■ 

1 

3 ; 

1 0 > 

3 

Fourth ' 

8 

1 ^ 

5 

■■ 

2 

0 1 


0 

To tals 

16 

16 

15 

16 

16 

If) 

16 

If) 


for those lowest in mlelhgonce scoies to prefer the essay cxainiimtion 
more than do those who received the highest ratings. This tendency is 
not as clear in the results from the second experiment In both classes, 
there is a slight tendency for those with the highest intelligence ratings 
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to piefer the completion cxammation more than do those mdividuala 
who rank lowest 

Before summauzmg the icsults of this study, a possible explanation 
might bo given for Lho lack of agreement between the losults repoited 
here and those lepoitcd by other investigatoie who have considered 
the lelntive merits of the essay examination. In all probability the 
reason foi the iclfitivoly high rating of the essay examination in this 
study is the objective mannci in which it was scoied. The procedure 
followed in scoring these tests is definitely comparable to the method 
of scoring the so-called objective examinations Consequently, 
this evaluation of the essay examination does not serve as a lefutation 
for the numcious arguments which appear m the literature opposing it. 
It merely intimates that an e^y-type exainmation may be so given 
and scored as to compare favoiably with the objective examinations. 
The labor involved in such a pioccdure, however, is so great as to 
make it almost prohibitive foi large classes 

Summary 

1. Four types of examinations, each covering exactly the same 
subject-matLcr, were given to a class m statistical methods in education 
and a class in educalional psychology. The nature of the four types, 
as well as the older in which they were given, was as follows' Part 
I, essay; Part II, completion, Part III, multiple-choice; Part IV, 
true-false. 

2 The intei cor relations of the tests m the couise in educational 
psychology suggest tlmt if icliablc tests arc constructed, one of the 
foui types used is probably as adequate as any of the other three for 
measuring the amount of infoimation which the incinbois of the class 
have accumulated The evidence foi this suggestion is not as clear- 
cut in the class studying statistical methods. 

3 If the composite scoie on thice types of examinations is used 
as the cnteiion foi estimating the validity of the fouitli type, the 
results indicate tlmt the four types of tests have appioximatcly equal 
validity. 

4 In both cxpeiimenta the completion tiud multiplc-choice tests 
prove to be most reliable In the second cxpeiiinenl the leliability 
of the true-false examination is not much lowci 

5. The correlation between mtclligcnce and the essay examination 
.s lower than between intelligence and either of the othei three types 
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6. Considering the choice of all the students in the two classes 
the muItiple-choicc and true-false tests are preferred to the other two 
types studied. 

7. There is a tendency for the highest ranking students in intelli¬ 
gence to prefer the completion examination more than do the lowest 
ranking students. In the first experiment this latter group prefer the 
essay test more than do the members of the highest ranking group 



an experiment designed to test the validity 

OF A HATING TECHNIQUE 

THEODORE NEWCOMB 

Westorn Roaerve Universily 

I 

The validity of ratings of behavior, provided that two conditions 
arc met, has been faiily generally accepted These conditions are that 
there be several competent judges,* and that they have ample oppor¬ 
tunity to observe the behavior being rated. Foi the paa t two summers 
the writer has been in a situation where both of these conditions were 
adequately met Data were gathered of such a nature that ratings 
could be compared with moie objective measures of the same behav¬ 
iors, and enough raters wcieavailable so thata study of the uniformity 
of the ratings could be made. 

The subjects for each of the studies here leporfced weze thirty 
problem boys who had been sent for study and treatment to a summer 
camp maintained through the cooperation of Western Reserve Uni¬ 
versity and the Child Guidance Clinic of Cleveland, Ohio The boys 
remained for a period of five weeks whcie they were under the constant 
observation of a psychiabiist and of six or more counselors trained m 
psychology and mental hygiene. 

The first summer, in connection with another experiment, the 
attempt was made to validate certain "objective” measuies of piob- 
lem boy behavior by comparing them with ratings on the same behav¬ 
ior The results were such as to make the experimenter conclude that 
the ratings were themselves being validated The evidence, however, 
was rather meager, and it was decided to gathei fuller data concerning 
the same problem. 

II 

During the first summer a daily iccoid was kept of “specifically 
remembered incidents” included under twenty-six different behaviors.^ 

' Note pai tiGularly llugg, H 0. la tlic Rating of Human Gliaraoter Possible? 
Journal EducalwuU Psychology, Vol XII, p 425 and Vol XIII, p 03 Rugg 
concludes that there should lie at least threo judgea who have had a fair chauco to 
observe subjects in the behaviois being inted 

*For a fuUci description of tins cxpoiimont, together with n description of 
statistical techniques used, see the wrilor's “Consistency of Certain Extiovert- 
mtrovort Beliavior Patterns in Fifty-onc Pioblom Boys " Teachers College 
Contributions to Education, No 382 
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Each boy‘s lecoul each day was kepi on n foim similar to the following 
sample' 

How wns he about getting up m the momiiig? 

Got up bcfoio i|suig hour 

Piomptly when cnlletl 

Dnlhed, lint on time for broakfait. 

Too late to bo on time foi bieakfaat 

Records wore kept for each boy by his own counselor, who had spent 
all or most of the clay with him. Besides these daily records, the 
experimenter recorded some 8500 mcidcnLs of Uic above twenty-six 
and other similar behaviors Then, at the end of the camp period, 
ratings weie obtained from each of seven men on the frequency of 
these same twenty-six behaviors Inasmuch as the observers had 
played, slept, and eaten with the boys noaily constantly foi’ five weeks, 
a fail degree of accuracy m the latmgs might be expected. 

Six of the twonty-six behaviors measured, however, wore of such a 
kind that no subject had been observed by nny but one man—his own 
tent counselor. Nevertheless, each of the seven observers was asked 
to give ratings on these six behaviors also, in terms of supposed or 
imagined freqiienoy. Six of the sevon ratings, \n other words, weic 
guesses 

It was not surprising lo find a toipcui coii'olaUow between daily 
record scores and ratings, of 409 + .102 foi the Iwcnly-six behaviors 
The range of correlations was fiom .02 to .73, What was somewhat 
surprising was that tho mean coiiclntion. foi the six guessed behavlois 
{i e., between daily records and ratings) was fully as high as for tho 
twenty observed behaviors The mean for tho former was .451 ± 
098, anclfoi thclatlei, .396 + ,104., The difference is not statistically 
significant 

The accuracy of the ratings became even moio questionable when, 
as measures of uniformity, standard deviations among the seven ratings 
for each behavioi were computed The mean SD foi the twenty 
observed behaviors was 88 (the ratings were on a scale of 1 to 5), and 
for the six guessed bchaviois, .81. Again tho difforonce is not sig¬ 
nificant, and it is evident that the raters agicod no moie closely about 
frequently observed beliavioia than about behaviors which they had 
never seen. 

Ill 

A year later there was a similar group of boya at the same camp 
Somewhat diffeient means of objective recording of behavior were 
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used, as will be described. More exLensivo ratings wore also obtained, 
and the problem of sUidymg then iclation Uj ficqucucy of observation 
was diieotly attacked this time, rather than stumbling on to it as a 
side-issue 

As before, dofiniLo types of behavioi wcic being studied, for 
example, seeking adult attcnliou. Cnids woic inimoogiaphed, on 
which weie listed all the common ways in which boys were actually 
found to seek adult attention When an incident of this soil was 
obseivetl, the card was checked with the appropiialc behavior, nt 
that time or as soon after ns was possible. Seven or eight obseivcrs 
who weie constantly on the watch for these specific bchaviois could ’ 
be piesumed to get a pretty fail sample of all such incidents that 
occurred Theio follows a sample card, showing one of the seven 
kinds of behavior that weie being studied 

Adui.t AanXNTlOU 

Date 
Timo , 

Obsoivoi 

Name of boy 

Hiking alone with oounsoloi 
Voluntarily woiIcing alono Midi counselor 
Hanging around couaseloi alone 
Voluntccnng m task for counselor 
Hanging aioiind couaseloi s’ slmck 
Complaining to eounseloi of uihneiit 
Tattling 

Special invitatinii to coiinsvloi 

Antics to annoy or diaw attention of eouiiKoloi 

Doinoiisliation ot aHection foi eounseloi 

Playing up to vwitois 

Otlicis (indicate on revcisc siilc) 

Altogether some fifty specific bchavvois were being thus rccoidcd 
day by day. Naturally, some of tlicso wore found to occur with gieat 
frequency, and otheis to bo compaialivcly lurc. Tliis matter of fie- 
quency with which the behavior is being icported may theicforc bo 
studied in iclatioii to the agicemcnt between the two measures of tlio 
same behavior.? 

It was desired to study not only the effect of fiequcncy of reporting 
upon the agreement of the two inensuros, but also that of mere fre¬ 
quency of occurrence of behaviors not being iccoided These proli- 
lems, added to that of the previous suinmcv, i e , a comparison of 
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observed ‘witli unobsoivcd bcimviois, made a total of aix j^inds of behav¬ 
iors to be studied, ns followh. 

1. Behaviors hemg lecortlpd lu IniRp mimltciB. 

2. Boliaviois hoiiig lorowlrd m Hiiinll numbers 

3. Behaviors not hniiiR roconlpil, but occurring frequently (ns dotermiucd by 
llio study of tho piovious suinmoi). 

4 Bohnviora nob lioing lopoidod, but orcuning rnrcly (an cleleimmcd by tho 
study of the previous auminor) 

6 Bclmviois observed m eaeli boy bv only one obsoi ver (his own coiinseloi) 

6 Behaviors never observed at all—imaginary <3iluations 

Ratings were thcrcfoic oblamcd on thirty behaviors, five in each of 
the categories just given. In Table I these behaviois nio tabulated, 
together with tho results of the ratings In the list as submitted to the 
raters, the behaviors wore of course not thus tabulated, but occurred 
in random order. The number preceding each behavior mclicates 
what this random order was. 

Directions for ratings were as follows: 

Tho following ratings aie to mdicate the frequency with which each behavior 
occurred Plenac into os follows * 

0 Novel occurred nt all. 

1. Bmc, very exceptional. 

2. Occnsionnl, not frequent 

3. Partly frequent. 

4 Very frequent; prominent characterislie. 

Indicate tho dcgico of yoiii rnling by placing aphis aftci the figuro if thcic is a 
fair degree of certainty, a minus if tlicroi^ consideiablc iinceitainty, and otherwise 
no sign 

In the case of behaviors whioli you have not observed, make the best possible 
estimate of how frequently it tcould occur 

Rate all the boys for behavior No 1, then nil the boys foi behavior No 2, etc, 

Tadlb I — Bbuaviohb on Which ItATiNoa Wbiib Obtained 
Group I llccoidcd in Lni^c Numbeia 
5 Lying or sitting around alone 
7. Bullying, with physical contact. 

13. Assuming position of promincnco at camp fire 
16 Antics to annoy ot draw attention of counsclois 
27. Interrupting or shouting abovo the group. 

Group It. Ilrcorded m Small Numbers 
1. Being crowded out, avoiding being first 
3. Taking tho initmln'e m fighting or boxing 
13. Complaining to counselor of ailment. 

20 Moping or sulking alone 
24. Profanity or obscenity 
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Gioup III Not Hccordcd—Frequently Observed 

2 Coming kto to incals 

11 Expicssmg enthueiasm 
17 Moving slowly while othris hiirncd. 

21, Singing nloufl 
23 Laughing 

Group IV Not Recorded—Raiely Obseivctl 

10 Boasting, or loudly announcing intentions foi the future 

12 Continued cliatting, loquaciousncsa, 

14 Remaining quiet while others were noisy 
10, Accepting discipline quiellv 
22 Failing to wash oi comb 

Gioup V Ohseivcd by Only One Coiinseloi 

4 Making his own bed neatly 

8 Taking more than hia aliaie of food, at table 
20. Readily conciniing with tent-'inates’ choice of activity 

29 Doing moie than lii.g share of after-meal work at camp 

30 Making noise m the tent before rising hour in the inoining 

Group VI Never Ohacived—Imagmaiy Rituationa 

0 Stopping play at a pieviously agreed upon hour and coming in the house 

9 Playing quietly m oider not to disturb sick sister, if asked to do so 
10. Minding the baby all Saturday aftcinoon, without leaving 

26, Giving up attiactivo plaything to younger biothci if he asked for it 
28 Tidying up his own lOom at home 

Thirty boys were thus rated on thirty behaviors by six observers. 
As one measure of the uniformity of the ratings, the SD of the six 
ratings was calculated, for each boy for each behavior Correlations 
between ratings and objective scores were also calculated for the ten 
behaviois being recoided (Groups I and II) Rating scores for these 
calculations were obtained by adding the six ratings for each behavior 
by each boy Objective scoies weie simply the total numbers of 
recorded incidents 

Reliabilities of the latings were also calculated for each behavior, 
by correlating the sum of the acoics of thiee raters with the sum of the 
other fchiee raters This serves as another measure of uniformity 
of the ratings The correlation between these measui’es of reliability 
and the .SD's for each behavior, is — 662, indicating that the two 
methods are measuring at least partly the same thing 

The lesults of all these calculations are given in Table II. 
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Tabi.e II 


Behavior 

number 

Menu of thirty 
<SD'h 

Coirolation 
hotwocii ImlvcH 

CJorrt'laLion 
with objective 

BCOIC 

Numl)or of 
luculcnte 


Gioup 1—Obsi'rvod ami Ut*floidi'il F»(*q\\putly 


5 

71Q2 

032 

180 

“l23 

7 

7218 

73(1 

612 

98 

13 

8004 

270 

002 

09 

16 

0042 

816 

052 

133 

27 

8000 

733 

010 

100 

Mean 

731)5 

047 

638 

10-1 6 

Group 11—Ohseivcd nnd Uccordetl Barolv 

1 

70(16 

73B 

010 

21 

3 

6960 

801 

310 

19 

18 

0168 

783 

413 

26 

20 

7110 

028 

158 

n 

21 

0315 

006 

081 

34 

Moan 

0782 

842 

3')n 

22 0 


Group III—-Not Itcfouiccl—I'Vcquently OI>Borvc(i 


2 

7‘IOB 

607 1 



11 

7400 

703 1 



17 

8213 

151 



21 

8040 

500 



23 


000 



Moan : 

■BaH 

•101 




Gtoup IV—Not llccordod—Kftioly Obspi vocl 


10 

12 

14 

19 

22 

Mean 

7182 

7105 

7977 

7106 

6943 

7289 

085 

751 

778 

801 

850 

703 



Ctioup V—Not Obscivccl Except by One Man 

4 

7161 

750 



S 

8097 

64S 



26 

7563 

860 



29 

7162 

901 



30 

8300 

479 



Moan 

7372 

700 



Gioup VI—Nevoi Obacvvccl—InmRiimry Inciticnts 

0 

8107 

480 



9 

7000 

474 



IG 


730 



26 





28 


1 720 



Mean 

1 7201 
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Considenng fiisi the correlations between the two measures, for 
which calculations wore possible only in Groups I and II, the mean 
coeMcicnts are respectively 538 ± 087, and .390 ± 105 The SD 
of the diffeiencG of IhcRC two coefficients, using the foimula 

SDdi/j = mean I + SD'^ mean II, 

18 1254, the difference being equal to 1.10 sigmas, which can not be 
said to be statistically significant. As fai as agreeing with the more 
objective measures is concerned, then, theic is no significant difference 
between behaviors frequently lecordcd and those larely recorded 

The relative unifoimity of the latings for each group of behaviors 
IS fairly obvious from Table II. The mean SD foi the groups of behav¬ 
iors langes between 6782 for Group II and .7741 for Group III The 
SD of the diffeience between those two values (using the formula 
already cited) is 0282, the difference being equal to 4.6 sigmas While 
this is a great enough difference to indicate probable significance, 
there is no significant difference between any other two groups of 
behaviors. The difference in this one case would seem to indicate 
that bohaviois being rccoided in small numbeis are more uniformly 
rated than those being frequently observed and not recorded; but not 
significantly moro consistently rated than those which were pure 
guesses Groups I and III, which represent behaviors frequently 
observed, have a mean SD of .7395 and .7741, lespectively, whereas 
Groups V and VI, lepiesentmg bchaviois never observed, have mean 
SB’s of 7372 and 7204, rcspeotively. Neither the fact of being 
observed ficqucntly, nor having been watched for and icpoitccl foi a 
five-week period lent any advantage m umfoimity of rating over the 
ratings which wcie meie guesses 

Theie was a baiely significant difference between behaviois No. 24 
and No, 17, those with the lowest and highest mean SD^8, respectively 
The sigma of the diffeience is 0427, the diffeience being equal to 
4 42 sigmas 

Mean SD'a for each boy weie also calculated, i e, the mean of the 
thirty behaviors on which each boy was lated Theie was somewhat 
moie umfoimity here than among tlie thirty behaviors. The lowest 
and the highest of these moan SD’a weic, respectively, ,6615 and 
8163. The SD of the difference is .051, the difference being equal 
to 3 03 sigmas. 

That this scarcely represents a real difference is further indicated 
by a calculation of the correlation between the number of recorded 
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incidents for each boy (langing from 26 to 295) and the mean SD 
for each boy This cooffioiont, reprcbcnfcing the relation between the 
number of recorded inciclotils and the variation ui rating'5 was 161 + 
120 This IS probably not siirpiieingj since the moie fact of not 
having lecordcd many incidents for certain lioys would give the 
rater a fair idea of tho frequency of the behavior being rated. Hence 
boys with few recorded incidents would tend to be ns nccuiatoly and 
uniformly lated as those with many. 

Very similar reaults are obtained by comparing tho average rclia^ 
bility of tho several groups of behivviois The only significant diffei- 
ence, again, is between that of Group 11 and Group III, the difference 
being equal to 4 1 sigmas Wo find the aveiage reliability of tho five 
guessed behaviors to be almost picciscly the same as that of the five 
behaviots most frequently scon and recoided. 

The moan correlation between one half of the latings and the other 
half is .683 This gives a reliability, by the use of the Spearman- 
Brown formula, of .81 In order to aocuic a reliability of .90 it would 
be necessary to have 2.1 times ns many latorsj oi about twelve. It 
should be added that the boys presented a wide range of behaviors, so 
that a faiily high degico of reliability should be expected 

Another aspect of ratings which interested the wiitei was the 
comparative uniformity of latings of spcoific behaviors and of gen¬ 
eralized traits Ratings were obtained on but two such traits, as 
follows: 

1 Degree to winch each hoy wna an acceptable member to those of his own 
tent group. 

2 Degree to winch each boy wna an acceptable mewlior to the majouty oi the 
tlmty boys m camp 

Ratings were made on a scale similar to that used in. the specific 
behavioi ratings, and the mean SD for each trait was .sunilarly cal¬ 
culated. The menu wore, respectively, 6705 and 6520, foi the 
above traits The self-coirelations were 885 and 655 respectively, 
'While these lesulis are not significantly different from these shown in 
Table II, they show comparatively high uniformity, and further meas¬ 
uring of other tiaifcs might havo sliown a teucloncy to rate traits more 
uniformly. It is to bo regretted that moio data wore not obtained 
at this point. 

In the above calculations the degiee of certainty which was indi¬ 
cated along with the nuinorical values foi tho ratings, has not been 
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considered. Would the results have been different if the numenonl 
values had been weighted according to the degree of certainty? 

Table III levoals suiprismg differences in certainty among the 
SIX groups of behaviors. There is a steadily decreasing certainty 
from Group I to Gioup YI The calculations shown in Table III 
were made by finding the algebraic sum of the number of boys rated 
with certainty (maiked plus) and the number of boys rated with 
uncertainty (maiked minus) for eacli behavior. 

Now, with such decided diffeiences m the certainty of the ratings 
for the various groups of behaviois, one might expect to find signifi¬ 
cant differences in uniformity of lating if ocitainty is taken into 


Table III — DsonEE op Gbbtaintt op Ratings foii Each Behavior 


Gioup I 

Gioup 11 

Group III 

Behavior 

number 

Cci tninty 

Bolmvioi 

niimbci 

Coitamty 

Behavior 

number 

Ceitainty 

G 


1 


2 

-2 

7 


3 


11 

12 

13 


18 


17 

20 

16 j 


20 

24 

21 

4 

27 

37 

24 

40 

23 

38 

Mean 

37 8 

' Mean 

25 0 

Mean 

17 0 

Group IV 

1 Gioup V 

Group VI 

10 

g i 

4 

-6 

6 

-23 

12 

23 

8 ' 

-11 

9 

-42 

U 

32 

20 

16 

16 

-10 

19 

20 

29 j 

37 

25 

-22 

22 

19 

30 

- 3 

28 1 

-10 

Moan 

20 6 

Mean 

6 0 

Mean j 

-21 4 


account Calculations weie theieforc made according to the following 
system of weighting; Ratings marked certain were weighted three 
times; those marked neithei ceitam nor unceitain weie weighted 
twice, and those unceitain, once 

Behavior No 9 was i*nled with less certainty than any other 
behavior. Its mean as given in Table II is 7096. Asiecalculated 
according to the above wcightmg, the moan SD is .6966—a negligible 
difference, 
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Behavior No. 15 was rated with the most certainty The weighted 
mean »5D is .6642; the weighted mean SD is .6552, again a negligible 
difference 

A third calculation was made, chosen at random, The mean 
unweighted SD for behavior No 1 is .7065; weighted, 7067—prac¬ 
tically identical It was thercfoic not thought worth while to recalcu¬ 
late the other behaviors, since the differences are oiivioiialy insignificant. 

The failme of this factor of ccitainty to lender more uniform the 
calculations may be explained by a fuithci con elation The relation 
between certainty and uniformity (ns mcasuicd by the mean SD) is 
— 0015 This means, of course, that raters diffcicd as muoh among 
themselves when fairly ceitain as when unccitain The only cod- 
clufiion to be drawn from the estimates of eeitauity, then, is that 
they tended to oonfirin the basis on which the six gioups of behaviors 
wcie chosen. The expciimentci was evidently fairly successful in 
choosing those behaviors which sliould bo rated with the most and the 
least certainty. The only difficulty was that ccviainty and uniformity 
had little or nothing to do with each othci 

IV 

Some light may be thrown on possible reasons for these i osulis by 
again referring to the study of the first summer. The twenty-six 
behaviors then measured wDie chosen as being classifiable undei some 
one of nine traits supposedly indicative of introvcrsion-extrovcision, 
Intercorrelations of all behaviors grouped under a given trait were 
calculated for both acts of data, i.e , ratings and objective records 
The mean mtcrcorrclation of these one hundred twelve intia-trait 
behaviors, according to the latings, was .493 ± .093, the mean of 
the same one hundred twelve intercorrelations, according to the 
objective lecords, was .141 ± .121 The conclusion may theiefoic 
be drawn that the halo effect, inevitable in the ratings, worked m 
such a way as to cause the rater to rate similaily logically related 
behaviors such as those classifiable under a single tiait The close 
relation between tho mtrn-tiait behnvioia which la evident in the 
ratings may, therefoie, bo presumed to spring from logical picsupposi- 
tions in the minds of the raters, lathor than from actual behaviors. 

This hypothesia helps to account for tho failme of the fiequontly 
observed behaviors to be rated more unifoimly than those rarely 
observed, or those never observed at all There is, of coiiise, one 
other possibility—that tho frequently observed behaviors aie, indeed. 
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accurately rated and that, by nifciriiiK fioin faniiluu bohaviois, the 
imagined situations aie rated with equal iiuciiraoy To lake tins 
latter position, however, is equivalent to sayiiiR that behaviors may 
be acciivaiely rated by guesamK at them when they have nevei been 
obscivecl Tew psychologists will be willing lo concetlo this U 
seems a truer statement to say that even with imiple oppoiLiiiuly for 
obsciving, tho ratings woie iiUlc oi no betlcr than guossos. 

The icsults of the study of dogiec of certainty I,end to confuin 
this view. Rateis agreed no more closely when faiily ccitaiii than 
when uncertain. The water veniuie.s a suggestion ns lo why Lins was 
true Assuming, as above, that the halo effect was at woik almost 
equally m lating ob.scrved and unobserved belnwiors (since the latter 
weiQ as unifoimly latecl as the foiinor), m the case of the foimer tho 
raters wcic able to locall incklenls supporting Ihoir "halo-iKcd^* 
improasion—conveniently foigcttmg, of courbc, tho incidents which 
did not support this imiHOssion Such ratings weio Ihercforo marked 
certain In the case of the unobserved behaviors no such mcideiiLs 
could bo called up, tho impression icnuunod, but could not l)c factually 
supported, and was therefore, marked iiumlam That the ratere 
agreed to a considerable degree indicates that Iheii' halos coincided to 
some extent That they differed indicates that each latoi had liis 
own private halo. 

The writer concludes, tlieiefoio, that under those conditmns, 
appaiently optimum for ruling purposc.s, riUnigs on Hpocific bohiiviois 
were so largely colored by tin* Hurrouniling halo as (o Ix' quite invalid. 
Neither fieqiient obsoivation of the behavior being ruled, fioquent 
recording of it, iioi weighting the scoies in accoidiince with the dogice 
of the ratei’s ceitainty had an appreciable effect on unifoimity of 
rating Behaviors never lecoided, never seen, and ilin.se felt to be 
highly uncertain wcic ns uniformly lated as those at tho opposite 
extremes Since the guessed rulings aie of highly queatioiuible valid¬ 
ity, must not the otheis, which me no more uniform, bo almost equally 
invalid*^ 



A METHOD FOR JUDCHNG THE DISCRIMINATION OP 
INDIVIDUAL QUESTIONS ON 'PRUE-FALSE 
EXAMINATIONS' 

C. II WnEI-PEN, JH AND F J J DAVIE-S 
YhIc Univotdit} 

I iNTnODirCTIOX 

The following introduolory comment on the scoring of truc-fnlse 
examinations is merely for the purpose of making cleaier some of the 
later portions of this article It is generally roGognizcd that whatever 
othoi method of acoimg a true-false examination may be used, the 
method of scoring by tho total of right answers is not satisfactory. 
If the number of questions is at all large, a man would be apt to get 
half his answers conect hy sheci guessing. 

A number of methods of scoiing designed to eliminate the effects 
of guessing arc possible, and the method adopted for any given case 
will depend upon tho particular condilious of that case One such 
method is the following, which was adopted at the Yale Law School 
for its true-false examinations. Pielimmary warning is given that 
guessing will be penalized, that if an answer has to be guessed it had 
bettei be omitted entirely. Tho oxaminalion is scored by adding the 
sum of omitted answers to twice the sum of wrong nnswcis. The 
lowest score is then best and the highest is worst. Tho theory under¬ 
lying the method is that guessing will bo greatly minimized if not 
entirely eliminated, and that simple lack of infoimation on a given 
question is not to bo scored against so heavily as dehnitely wrong 
information on that question. 

The minimizing of guessing thioiigh tho prclimmary warning seems 
to be accomplished. A bnef investigation has given about as certain 
an indication of that result as is possible Out of seven examinations 
given in June, 1928 it was found on all but one that the group of men 
with the highest average law grades for the year (the Lop third of the 
group taking any one examination) had a smaller proportion of then 
examination scores accounted for by omitted answers than did the 
group of men with the lowest average law grades for the year (the 
bottom third of tho group taking any one examination). On the sixth 

* Tho subatance of a lopott prcpaicd tor the Yalo Liiw School aad tho Depait- 
meat of Personnel Studj of Yale UmveraiLv 

200 
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examination, as they are listed in Table I, the propoi Lion ran slightly 
the other way but not sufficiently so to destroy the significance of the 
evidence given by the other six The indication might be taken to 
be that the best men guessed more than the poorest men. Logically 
the poorest men would be expected to do the most guessing, as anyone 
with much to gain and little to lose by talcing a chance is most apt to 
take the chance The indication, therefore, is rather that guessing 
was so well minimi25ed that the pooicst men did not reveal their 
relatively greater propensity in that dncction and that the best men, 
not lealizing their own limitations so clearly as the poorest, gave 
evidence of incorrect information where the pooiest men admitted 
lack of all information. (See Table I) 

One of the chief objects of a true-false examination and of its 
scoring, as in the case of any examination, is, of course, to discriminate 
adequately between men of diffei*enl ability. A true-false examination 
correctly scored may give such discrimination fairly well, but at the 


Table I.—The PEnciiiNTAaEs op Totai* Group Scobes Dug to Wron'q Answers 
AND TO Omitted Answers on Seven True-palsb Examinations, Yale 
Law School, June, 1928 


Course 

Group X, top thud of tho 
men taking caoh exami¬ 
nation—according to then 
law grades for year 

Group Zj bottom third of 
men taking each exami¬ 
nation—eiccoiding to their 
law grades for year 

Per cent of total score duo to^ 

Per cent of total ecore due to 

Wiong ^ 
anawQTS 

Omitted ^ 
answers 

Wrong 

answers 

Omitted 

answers 

1 

88.3 

11 7 

1 84 7 

16 3 

II 

94 2 

5 8 

90 9 

9 1 

111 

03 8 

8 7 

i 92 9 

8 1 

IV 

92 8 

7 2 

92 4 

7 6 

V 

94 6 

5 4 

91 7 

S 8 

VI 

96 0 

4 0 

90 6 

3 4 

VII 

94 0 

6 0 

00 8 

0 2 

Seven examinations 

93 4 

6 6 

91 3 

8 7 

1 


Note —The table la doaignod for tho comparison of Group X with Group Z 
If tho table is used for a compaiisoii of wrong answer percentage with omitted 
answer percentage within either group, ifc should be remembered that wrong 
Rttawera aro multiplied by two before going into tho total score 
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samo time ccitain questions on the evaminulion may give it much more 
adequately than oUiers A qucslioi), for example, may contain some 
subtle nmbiguily which will clisliiicl the bcltni' men but will not 
trouble tlie poorer men at all, anotlici may be ho difhcull that only 
the exceptional niiiii can answi-r il coiiectly while all olhoi's fail to 
comprehend it regarcllo^s of the vuryiiiR ilogiecB of Ihcir actual ability. 
Another question may bo bo simple or fundamental as to be answerable 
by pvactically anyone who hns been exposed to Lhc subiccl-inatLcr 

In Older that tiuc-falso examinations may bo impioved ui con¬ 
struction so as to disciiminalc inoie adequately between men, it ig 
impoiLant tliat a, method shall be available for judging the relative 
power of cliscnniinnlion of the diffcicnt questions Avhich have been 
included m siicli examinations in the past. As a prclimiiiary to the 
development of any such mclhod it should bo iecogni;iod that wheiever 
possible the basis for the judgment on the individual questions should 
be the same ns th(? basis selected as coircct for the scoring of the exami¬ 
nation. The chscriminaLion given by the examination ns a whole 
IS only the net result of the discnmination given by the individual 
questions. 

H. Theoiiy 

If the relative tibilitics of men in the general field undei' examination 
can be determined indcpendonlly of lhc specific examination which 
is to be judged, it can be said that the examination, if it discriminates 
coricctly, should give those men scores whicli will vary in accordance 
with the independently detciinincd measures of Ihoir respective 
abilities; such scoies may bo called Slandaid Examination Scores. 
Tor the sake of initial simplicity in exposition, in spite of the criticism 
already made of scoiing by the lolal of light answers, consider the 
case of an examination of one hundred qucalions scored on the basis of 
total right answers, but with guessing supposed to lie non-existent. 

Suppose that the examination is so perfectly discummating as to 
give a &C 01 C of 80 to any man whose independently meusuiecl ability 
m the field is 80 on a scale of 100 Suppose there are one liuiulied 
such men. Each one will have given the rigiit answei to eighty ques¬ 
tions. If all Iho questions are of oxaclly equal caliber, not nil the 
one hundred men will have given the light tinswor on any one question 
or the wrong answer on any one question. By definition the questions 
are of equal caliber In the hands of this gionp of men of equal ability 
each question will consequently be answered light by eighty men and 
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wrong by twenty men, that is, the standard man-scoie pei question 
will be 80 on the basis of right-answoi scoring 

Similaily, if there is another group of one hundred men, each of 
' whom has an independently measuied ability of 60 on a scale of 100, 
each one of the one hundred questions of equal caliber will be answered 
right by sixty men m this gioup. If the men in the first group obtained 
scores of 60 instead of 80 and the men in the second group scoies of 45 
instead of 60 (that is, if m the first group each question was answered 
light by sixty men and m the second gi'oup each question was answered 
right by forty-five men) the examination would have been one of 
gieater difficulty, but each question, as well as the examination as a 
whole, would still be disoiiminatmg ooiieotly between the men of 
the two grades of ability The men of the second group are still 
shown as possessing three-fourths as much ability as the men of the 
first group, 

If one question, however, is answered right by eighty men in the 
first group and by eighty men in the second group, it does not dis¬ 
criminate between the two grades of ability. If all the questions were 
of the same caliber and gave this result, the score of each of the two 
hundred men on the examination would be 80 and the examination 
would not be disonimnating os between the two groups of men of 
different ability. Similarly, if a question is answered right by eighty 
men in the first gioup and only forty men in the second, the question 
18 over-discriminatiEg. If a question is answered right by forty men 
in the first group and eighty in the second, the question gives reverse 
discrimination 

Go back to the case of perfect disciimination by each question 
If there had been fifty instead of one hundred men m each of the 
two groups, the number getting each question right would obviously 
have been for each group one-half of the number found in the case 
of one hundred men to a gi oup. If, on the other hand, there had been 
two hundred instead of one hundred qu^tions on the examination, 
if all othei conditions and assumptions lemain the same, the exami¬ 
nation score of an 80 man would have been 16-0, and the score of a 60 
man, 120, If m this latter case there aie also two bundled men in 
each group, each question will be answered right by one hundred sixty 
men of the first group and by one hundred twenty men of the second 
group. 

Whatevei the standard examination score is for a gioup of men of 
given ability as independently measured, the number of men in the 
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gioup which will get vight each one of the sot of perfectly dieeriminatmg 
questions of average difliculty is given hy the pioducfc of the standard 
score and the intio of the number of men in the group to the number 
of questions on the examination If the mmibei of men of given 
abilit 5 ' in one group is fifty and the munlKT of questions is two hundred, 
the standard score foi ibe men of that group being, say, 160, the 
number of men getting oaeli such pcrfpct qiiehtion light will be (160 X 
®/^oo)' that IS, 40. This roliitionsliip must bo ufiecl to reduce the 
standard question-score per man to the standard man-score per ques¬ 
tion, that IS, to reduce the atandaid examination score to what is 
hereafter called the stanclaid conecfccd exiiniimition score 

Not all the questions will he simply of average difliculty, One will 
be slightly move chfiiouU, another BlighUy less, but they may still 
discriminate correctly between the guides of independently measured 
ability In order to judge quickly the degree of diBcrunination shown 
by any question, it will be convenient to express the standard man- 
soorcs per question as rafcioa of one iinothcr. If, for example, the 
standard corrected score for a group of men of 80 ability is 30 and for 
a group of men of 60 ability is 16, Lho latio of the score foi the first 
group to the score for the second is 2 00, Then if on a given question 
twenty men of the first group and ten men of the second answer 
correctly, although the icspeetivc scores ave not the standard corrected 
scores, it is at once clear that the question still discriminates correctly 
between the two groups, for the ratio of the scores niaclc on the question 
is 2.00. 

When tho whole number of men taking an examination is divided 
into groups according to their independently measured abiliUcs in the 
field (three such groups will generally be advisable foi the pin poses 
of the later judging of the questions), it will rarely, if ever, happen that 
all the men in any one such group will have the Barnc independent 
measure cf ability. The grades taken as measuring this general 
ability will Yary within each gioup. Tho independent measure of 
ability for each group of men as a whole will bo the average of their 
individual measures Correlative witli thrs average for the group 
there will be an average standard oxaminatioJi score in place of tho 
single definite standard examination score implied by the discussion 
which has preceded. 

The fact that the standaid score foi each group is in the natuie 
of an average taken from variable nmabincs requires another modifi¬ 
cation in the criteria used for judging the disoiimmation of the indi- 
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vidual questions. Allowance must be made for the existence of 
variability within each group, for ifc mfciocUiceg the probability of 
cliance-fluctuations in any mcasuics of the operations of the group 
The piactically ceitain limils of variability within any group, which 
does not depait too far from normal m its cUsUibution, is given by the 
range of three times the sigma (Slandaid Deviation) of the group 
above and below the anthmolic average of the group The sigma 
of the independent measures of ability for each gioup must be found, 
and then translated, m the foim of a percentage of the mean fiom 
which it is calculated, to terms of slandaid examination score, just as 
the aveiage independent measure of ability is to be found and trans¬ 
lated; the process of this translation will be described m detail. The 
translated aveiage and the translated 3-sigma lange give a standard 
range of corrected examination scores foi each group. 

For example, a group of mon with average independently measured 
ability of 80 may have a standard range of corrected examination 
scores of 60 to 40; and a group whose independent average is 60, a 
range of 30 to 20 Ilespcctive sgoigs on a given question which fall 
within these ranges will now be the index of a correctly disciimmating 
question The actual scores might be CO and 20 icspeotively oi 40 
and 30 respectively. Either pair of scores must be taken as indicating 
correct discrimination since the two scores of encli pair aie within their 
respective 3-sigma limits of variation. 

To keep the advantage of having latios between scoi es, instead of a 
companson between the scores themselves, for judging the degree of 
discrimination shown by a question, the limiting scores for the groups 
may be expicsscd as latios of one another (the upper limit of one 
group as a ratio of the lowei limit of another, and the lowoi limit of 
the first as a ratio of the upper limit of the second). The result is a 
range of ratios, instead of a single latio, to be used as the ciiterion for 
discrimination. In the example last given, the lange of ratios foi 
criterion is to or 3.00 to 1 33 

The same theory and method apply whatovci the system used 
for scoring tho true-false examination In the case of fcho Yale Law 
School examinations to which the method has been applied the system 
of scoring, as explained before, was twice the sum of wiong answcis 
plus the sum of omitted aiiswcis. The Uansilion fiom queation-acoie 
per man to man-score pci question follows heie just ns it does in the 
case, used puicly for illustrative purposes, where scoimg is by the 
total of right answei's The question is always scoied by the system 
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which is usGcl to scoie a man on the whole D\aininiitiou, In this case, 
therefore, each aiiswei is scoiccl for each of the groups of men by twice 
the sum of the men getting it wrong plus the fliim of the men omitting 
il Tlio thcoiy no longer says, ns in the case of the preceding illustra¬ 
tions, that of 11 gioup of moil, ail of 80 ability as indopcndenbly meas¬ 
ured, 160, Hiiy, if Ihul is the stanihml corroded Hcore for the gioiip, 
^Y^ll give the light answev on oach of iv wl of questions of average 
cUfhculty and coirect cliscriminiilion. It says iiivSteiKl that the men of 
such a gioup will on such a set of quoslions of equal calibei give the 
right answci to one question just as frequently as to any other, will 
give the wi'ong answer to one question just as frequently as to any 
othei, and will omit one question j*U8t ns frequently ns any other. 
The ficquency of answenng right, nnsweiing wrong, and omitting to 
nnswoi depends upon the level of ability of tlic men in the group 
The Iheoiy says, in other woids, that the man-score per question lu 
such a case will be the standard conected ovamination score, all 
scoring being by a common system. 

The one important point so far omitted from consiclciatLon is the 
matter of traiisitioii from the iiulopendciitly cletcimincd measures of 
ability in the field to the scores on a partiouhir examination, In 
speaking of independently doLcimiiicd measures the meaning is simply 
that such measures must not be determined solely or primarily from 
the results of the examination of which the questions lue to bo judged 
for discrimination. 

In the case of the Yale Law Sohool true-false examinations the 
independent measure of ability of a man was simply his nvciage law 
grade for the year. Such a grade was felt to be sufficiently inde¬ 
pendent of a man'fl showing on any one tiue-falsc examination to 
which the method of judging questions might be applied. The man's 
law grade for the year is the average of all his grades in all his courses 
Geneially a man would take about five courses and in approximately 
three of these, as the general case, would be given a true-false exami¬ 
nation. Almost Without exception such a tiiic-false examination 
would not stand alone m the course but would bo supplementary 
to a written examination of the usual typo. A man’s showing on 
any one true-false examination m any one course is, therefore, but 
a small part of his average law grade for the year m all couisea. Such 
average year grades are not, of couise, precise measures of ability m 
the field of law Such grades, however, and it ia the only important 
point m this connection, will be as good a reflection of the relative 
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diffeiences m ability of a group of men as is possible with anything so 
arbitrary in nature ns an academic giade. 

The connection between the mdependently determined measures 
of ability and the scoring of the given examination of which the ques¬ 
tions are to be judged for disciimination may be made by a simple 
transmutation. A generally satisfactory method of making the 
transmutation for those scores which aio necessary in the establish¬ 
ment of cnieria for the judging of questions, without any waste of 
tune over those scores which are not necessary for the purpose, may be 
illustiated by the procedure followed m the case of the Yale Law 
School examinations. 

The average oi yeiir-grades of all law students foi the year con¬ 
cerned aie tabulated in a frequency seriM and cumulated downward 
from the higher giades On the examination to be judged the scores 
are similarly tabulated and cumulated downward from the lower 
scores, since on the system of scoring used a low score means a better 
showing than does a high score Suppose theie arc three hundred 
men represented in the general distribution of year-giades and ninety 
in the distribution of the scores on the particular examination The 
ninety men taking the examination have been divided into tlirce 
giDups of equal size accoidmg to their year-grades Suppose that 
one of these groups has an average of SO in year-grades In the 
general distiibution of yeai-grades there is found the percentage of 
the three hundred men with grades of 80 oi higher In the distribution 
of examination scoies this same percentage of the ninety men there 
included will have attained or exceeded a certain score (exceeded here 
in the sense of getting a lower score). This seoie is the transmuted 
equivalent of the eighty m year-grades. When this score is multi¬ 
plied by the ratio of the number of men m the particular group (30 
HI this case) to the number of questions on the examination, the product 
is the average standard corrected examination score for the group 
The calculation of the 3-sigma range of variation follows directly at 
this point, m accordance with the method alieady indicated and 
explained more precisely in the section on Procedure 

This method of tiansmutation assumes only that grades or scores 
on any one examination of any kmd in the Law School will tend to 
follow m their actual significance a distribution which will be fairly 
uniform with the distribution of final yeai-giades given to the students 
in the school The assumption is one of similarity and not of coinci¬ 
dence So long as the particular examination is intended for no 
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unusual puiposo but simply for the customary testing of relative 
abilities, and so long as the number of eases in the distributions of 
grades and scores is fairly large, the nfaumptioii seems justified. 

The rules for piaotical |udging of the questions, as well as the 
exact method of establishing the criteria for judgment, are given in 
the seoUon on Procedure. The language of this section, which follows 
shortly, applies specifically to the Yale Law School examinations but is 
easily generalized The actual rules find their premise in the under- 
'lying theory of the system, as that theoiy has been sumraaiized here, 
but they have modified and developed out of practical experience in 
judging questions on seven true-false examinations given m the Yalo 
Law School in June, 1928 No new modifications of these rules were 
found nccessaiy when the system was applied to other examinations 
given in the school in Febiuaiy, 1928 and in Fcbiiiary and June, 1929, 
but they should be considered as still open to modification as more 
experience with the system is gamed. As given m the section on 
Pi'occduic the rules aie for the most part self-explanatory 

A test has been made of the validity of the results obtained in the 
application of this system of judgment to Irue-falso examinations 
given at the Yale Law School between 1928 and June, 1929. The test 
consisted in a senes of linear conolaiions between average law grades 
and the true-false examination scores. 

It should be lomembered that the object of the system of judgment 
is to classify the questions according to Ihe natuie of the discrimination 
they tend to show as Irctwecn students of difCeicnt abilities. The 
Bbandaid for judging such discrlminaUon by the questions is baaed 
on the iliaorimmafcion actually made between students by then law 
grades. Thus, if the judgments given by the system are coneot, the 
scores made on an examination composed entirely of discnminaling 
and over-discnmmahng questions would have a high degree of positive 
correlation with the law giades of the men taking the oxamination; 
those made on an examination composed entirely of non-dtscrimmaling 
questions would have a very low coirolation; those made on an exami¬ 
nation Gomposed entirely of reveisely discnminaiing questions would 
have a negative correlation 

The test, in its particular form, was auggestod by Mi Paul W 
Burnham of the Department of Personnel Study at Yale The results 
of the test are given m Table II. It will be obscivod that throughout 
the eleven examinations listed in the test the correlations of law grades 
with the actual examination scores arc lower than the coiielations of 
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law grades with the scores which would have been obtained if each 
examination had consisted only of its discrimimling and over-d^s- 
criminahng questions, and that those lattei* correlations in themselves 
are positive and relatively high. It will be observed, further, that the 
correlations of law grades with the scoies which would have been 
obtained if each examination had consisted only of its noiirdiscnvn- 
naltng questions arc in still another categoiy of distinctly low degree, 
and that the correlations of law grades with scores based entirely on 


Table II—Courblationb between Average Law Grades and Tiute-falsb 
Examination SconEs, for Eleven Examinations Given at Yale Law 

School, 1928-1929 


Examination 

Cocflicicnts of con elation 

Law glades 
With actual 
examination 

SCOICS 

Law giadcs with examination scores that would 
have been obtained if examination had consisted 
entirely of its— 

Disciiminating 
and over- 
disciiminating 
questions 

Non- 

discnmmatmg 

questions 

Reveisely 

disoiimmating 

questions 

I 

71 

1 

29 

- 26 

II 

82 

I 87 

40 

- 27 

III 

69 

: 78 

41 

- 36 

IV 

66 

60 

20 

~ 24 

V 

75 

84 

; 29 

- 36 

VI 

46 

68 

40 

- 08 

VII 

67 

72 

10 

- 31 

VIII 

50 

76 

12 

- 63 

IX 

61 

81 

- 02 

- 64 

X 

68 

' 67 

28 

“ 24 

XX 

i 66 

71 

36 

- 48 


Note —GoefRcients are positive except where indicated as negative 


reversely discnminating questions are uniformly negative The degiee 
of success in the application of the system obviously varies fiom 
examination to examination, but shows a maiked variation downward 
m only one of the eleven examinations tested (number VI as they are 
given in Table II) The correlations obtained are such as appaiently 
to establish the validity of the judgments. 
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III. PllOCHDURi: 

The following aie in.strucliona for judging qucHtions on Inie-false 
exftiTimations of Yiilo Law School. KacU numbeved paragraph la 
horcinnftcr refovred lo aa a aocUon. 

1, On oncli PxiimiiKitioii jjapc'r for n givoii evnniiimlioii plnoc tho aUicIcnt'a Inv 
grade (aveiARO gi'ftflo for vear in nil conrses) n»j tho indopenrlcnt incnsuro of llio 
atudont'a ability. 

2 ror tho given rxniimmtion gioiifi inalvc n (liiliihulion plot of Llio law gratlos, by 
tenths of per cent (Ponn 1) 

3 Lorn Porm 1 divide the oxamiiiation into fcliico mi\)-gioupB according to Imv 
grade, each sub-grcnip contamit^ the aaiuo number of wtudents Gall these 
three gioups, m descending ordoi of law ginde, A', 3'^, and Z, leapcctivcly 
Note —Should the examination group not be exactly divisible by thieo, it will 

be necessary to omit one oi two cases taken from tho iniddlo of tho group, such cases 
to be given no further consuloiatiou. 

4. Accoiding to the division dotoiininod in section 3, soi t tho examination papers 
into tho three sub-gioups X, Y, and Z. 

6 Tabulate law grades for pftchflub-gioup A", V, and Z, using claKs-mtorval of one 
per cent (Form 2). 

0 Plot separately for each of the suh-gioups Y, Y, and Z tlio \\ loiig answers and 
tho omissions on oacii quostioii m the cxaniination (Fouu 3) 

7. Prom Form 3 transfer to the icBpcctivo columnB A', 1', Z, and Total on Form 4 
the scores oC each quostian. 

Note —Tho scoio is to be calculated by using the same linsis as that used by 
tho Law School fot scoilng a student’a examination paper, eg , in June, 1028 the 
student’s scoio was given by Iwu'O tho aum of liis wrong nnswcis plus tlio sum of liu 
omitted answers 

8 Tabulate the average law grades Inst loporlcd by tlio Law School for nil 
students in tho school, using a classhinterval of one per cent Then cuiniilnte 
downward from tlio high grades (Form 6) 

0. Tabulate tho scores on the giYcn oxammalion (sub-gioups A', Y, and Z com¬ 
bined), using a clnss-intorval of ono point Then cumulate downward from 
tho low scores (Form 0), 

10 From Form 2 oalculato the arithmetic mean and “sigma” of law grades for 
each sub-group X, F, and Z. 

11 l^’or each sub-group X, Y^ and Z uso the following pioceduio 

(o) Take tho sub-group mean law grade as found m section 10 and find in the 
cumulativo cliatnbution column of Foim 6 tho nunibci of students having 
that or a higher giadc, Express Una tnunbor as a poicentago of the total 
number of studonts, i e, of Af on Foim 6 
(b) Apply this pojcentago to tho uumborof students in the oxainmation under 
review, t.o,, N on Foim 6; m tho cumulativo distribution of Foiin 0 locate 
the figure so gained and road tho corrcsiiondinB score in the cxamuiation 
score column of fcho same Form This scoio is the average standard exaui- 
inalton score for fcho group 
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(c) Multiply this aveiage stamlaid examiniition scoie liy tho latio 
Number of flbudents m sub-group (.X, y, or Z) 

Number of questions on examination 

Thcicsult IS Ihd average slandai d corrected examtmlion scnrcfoi the gionp. 
(fi) Rlultiply tins nveinge standaul collected examination seoie by the ratio 
biginn (ns found in section 10) 
mean (ns found in section 10) 

The losult IS the alaiulard conecled scoieoalne of the nigma-vanalion for the 
giouji 

(c) Three times this standmd collected scoic value of the sigma-variafcion 
(just found in d) added to and subtracted fioni the aveiage standard col¬ 
lected examination &coio (found in c) gives the slaitdard range of scores for 
the gioup 

12. List tliestandaid inngoof scoiesfoi the bliiccsnb-gioupson Form 4 and express 
them as ratios, thus' 

X Vp per h mit of X ^ Lower limi t of X 

Y Lower limit of Y Upper limit of Y 

Y Upper limit of F ^ Lower li m it of Y 

7j ' Lower limit of Z Upper limit of Z 
X Up per limit of X ^ L owci limit of X 

Z Loxver limit of Z Uppei limit of Z 

13 Grade as N (see section 16 below).those questions which have in each aub-gioup 
X, 7, and Z sooiea le&s than the lower limit of the standaid lange of scoies for 


aub-gioup X as found in section lie 

Note, —If a question is so easq' that in each siib-gioiip the scoie is less than 
would nojmnlly be expected m oven the best sub-gjoup, it is obviously a noii-clis- 
cnminating question If a question ib difficult and m all siib-gioupa only a vciy 
few men get it right, it is advisable to apply the tests for discnmination given below, 
since It 13 inoie in the imtuic of a difficult question to be disoiiminating 
14 Foi fill lemaining questions fill in the ratio columns on Foim 4 as follows' 
Caleulato and entci tho X/Z ratios, calculate and entei eithei the X/Y latios 
01 the Y/Z ratios, wluebevei has the smallci upper limit in the Standaid Ratio 
Ranges (as found in section 12 and listed on Foini 4) In calculating these 
latios considei a zoio scoie as a scoie of one X/F willnonnally be the second 


ratio used 


Note —Two latios foi the questions me sufficient foi giading purposes, the 
thud latio, when neecssaty, being determined by the iclation between the othei 
two, thus. 7/7 equals X/Z divided by X/Y, and X/Y equals X/Z divided by 
Y/Z. Assuming foi the moment faiily noimal dKliibutions ivithiii each sub¬ 
group, the Y/Z standaid latio langc will have a smallci uppei limit than the X/Y 
standard ratio mngc if the mean law gindeof sub-gionp Z is fnithcr below the mean 
of sub-gioiip 7 than the mean of siib-gioup Y is below the inpnn of aub-gioup X 
That IS, the Y/Z latio will be used in picfcrence to the X/Y latio if tho Z gioup 
shows gieater diveigence fioin tho 7 gioup than tho 7 gioup shows fiom the X 
group If the sub-group dish ibulwns are ktghly aftnoi mal so that the B-aigma ranges 
overlap badly, the system will be a/pphcable only after extensive modification, if at all 
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15 Cirftdo nccoulnig to Ih^ followinR \«lo« the tcnmuuug qucHtion^ on Foim i, le, 
thoao (\ueRtion8 not gradwl iV undfr sfctioa 13 
(n) Orailc ns A'’ (eco snelion 10 below)' 

(1) CJuostianR nith X/Z inlio Kiouloi tlinn 1, but the totnl scoio of the 
qiioqtioii IS less Ilian tliiei* tniins Uio lowei limit of tlio Standard Range 
of Hcoica for sub-Kioup -Y ni found m uoclion 11c 

Note—I b is fclb umviHO lo Inbcl a question llevLTsnl instead of Noii-discrim. 
mating (oi (lvoMli«Rvmvinalii\R inaleiwl of Bimply IbsciumuaLing) unless the 
ciucstwa IB of sucli cUfTiculfcv tlial tlic total araie tt« all tluee auli-gioups is at least 
equal to throo tunes tho lowest seoiP iioiinnlly oxpeeled in the best sub-group, 

(2) QueationH wjlli X/Z lalio equal to 1, oi between 1 and tlio uppci limil 
of the X/Z Standard Ratio Range m found m section 12 

(6) Grads as 7? (see soclmn 16 below) Q''<^>’bon8 with X/Z latio gicntor than 
1, and the totnl scoie of the queslion is equal to or more than three timea 
the lower limit of the stamlard langc of scoies for s\iU-gvov\p X as foimd m 
ficotion 11c 

(c) Grade os 0 (see section 10 below) Questions satisfying all tho following 
reqiiironicnls' 

(1) X/Z ratio less tlian the lowei limit of ita stniulaid lango ns found in 
section 12, and 

(2) X/Y ratio (or 1 /Z ratio, whiphe\er in used im determined in section 
14) less than the lower luiutof its Htarwlurcl range iia found in section 12, 
and 

(d) The third intio no gioator than the upper linut of its standard langc qs 
found in aeotion 12, and 

(4J Total score for the question equal lo or moio tlmn three timoB the lower 
limit of tho standard mngo of scoios for suli-gioiip A' as found in bcc 
tion lU 

(d) Qrado as /) (see section 10 below) ‘ 

(1) Questions that satisfy roquiroineiit (1) foi an 0 question (ni paiagiaph 
c just above) but do not Hntisfv one or luoie of llio other lequiicmcnts 
for an 0 question 

(2) Questions wjtli tho X/Z ratio within tbe limits of its standaid uingo as 
found in section 12 

16, Definitions of classes of judgment’ 

N Questions that do not diBcriminato between auli-groupa Each sub-group 
tends to react similnilv to such questions, making tho questions of no value as a 
test of comparative ability between higher and lower sub-groups 

It. Questions which cliacrdniimte inversely between suli-gioups In such ca^ca 
students with tho higbor law gindoa obtain poorer results thnii do students with 
the lower law giadea 

0 Questions tlial discummato Imlwecn suli-gioups lo a greatoi extent than 
isjustifiocl by the iclptivo levels of law grades 

D Questions that make normal discrimination bctwisui sub-gioiips 
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1—DisTniBUTioN Plot op Year Law Grades for Students Taking 
True-palsh Examination in . , June 1028 



NB—The solid lines maik the division into tliier groups A', Y, and Z, oacli 
containing 81 cases. 

^The two cases at the middle of tlio distnbukon which are omitted from 
all further consideration, making the whole gioiip exactly divisible into three 
sub-groups, 
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Foum 2—CiiioAip DifiTuiBimoHtt ov Ylui li^w Ciuaw.*? vou Rtudbnts Takinq 
T nuE-PALflK Examination in . , Junu 1928 


Croup X 

(iioHp y 

Cioiip Z 

Gi ftib 

Nuinbpi of 
Btiidcnts 


Niimhcr of 
HludonU 

Cbado 

Number of 
Htndcnls 

81 

1 

73 

1 


11 

8 

2 1 

2 

5 

' 0 

fi 

2 

1 1 

i 

ft 

5 

' 0 

1 

, \ ' 

7ft 

Z 

4 

4 

SO 

1 

GO 

ft i 

3 

3 

79 

1 I 

8 

7 

2 1 

2 

8 

1 


— ' 



7 

Z 

'roitti 

31 

'I'olal 1 

31 

0 

4 





6 i 

4 





•1 ' 

2 ' 





3 

<1 





Total 

31 






Form 3.—Chuck i\x CiOKHtioNB, of Nhmbku STuoiiN-rs in Each Sto* 

GRour X, Y, AND Z Anbwbrino Whono ou Omitting Anhwch, on Tauu- 
FAHBM Examination in ... JuNi) 1928 



Group X 

Group Y 

Group Z 

Question 




1 



1 Wrong 

Omitted 

' Wrong 

Omitted 

Wrong 

Omitted 

nurabci- 


1 answer 

nn&woi 

1 anflwov 

answpv 

ftHSAVer 

auawcT 

1 

1 

0 

0 1 





2 ' 

12 

2 I 





3 

U 

3 1 


(Bimiltvily) 


4 

5 i 

0 





5 

11 

7 1 





e 

3 

8 ' 





Etc 

Etc. ; 
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FonM 4 . —Judging Ciiitbiiia, Sconce, Ratios, and Question Grades eor 


True-palbb Examination in .... June 1928 


Sub-group 

Standard range of 
scores 

' Standard ratio 
ranges 

Score criterion 

X 


10-13 


X/Y, 

81- 63 

Foi N Each sub- 

y 


16-19 


YfZ, 

00- 67 

group score 9 or 

z 


21 

;-24 


xiz. 

62- 42 

less. 

For R and V : Total 








score 30 or more 

Question 

Score 

1 Ratio 

1 

Question grade 

number 

AT 

D 



x/y 

X/Z 

1 

0 

3 

4 

7 



N 

2 

26 

23 

30 

70 

1 18 

87 

N 

8 

31 

39 

33 

103 

79 

97 

N 

4 

10 

20 

23 

53 

50 

44 

D 

a 

20 

81 

30 

00 

04 

74 

N 

6 

14 

8 

8 

30 

1 76 

1 76 

B 

Etc 





Etc. 




Fonu 6—Simple and Cumulative Distridutions of Year Law Grades for 
All Students in the School, June 1028 
_ (These Figures Aro Hypothetical)_ 


Grade 

Number of students 

1 

1 Simple distribution 

Cumulative distribution 

90 

1 

1 

80 

0 

1 

88 

4 

6 

87 

2 

7 

86 

10 

17 

86 j 

3 

20 

62 

8 

284 

61 

4 

288 

60 

7 

295 

50 

2 

297 

58 

3 

300 

Total {N) .. 

300 



Applying section 11 Suppose mean Jaw grade foi a Group X la 85, it is found 
here that 6.7 per cent of the total men m the school had a law grade of 85 or better 
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FonM 0 —.Simple and Comulativb Dibthioutions op Examination Scores on 
TnoE>-PAiiaB Examination in .. , , June 1028 

(Thoaa Figwrcfl Arc Uypotholicivl) 



Nuinhor of stiidoata 

Scoro 


— 


Simple distribution 

Cumiilativo distribution 

1 

20 

1 

1 

21 

1 

2 

22 

0 

2 

23 

4 

, 0 

24 

* 1 

3 

0 

66 

4 

00 

60 

0 

00 

67 

1 

01 

68 

2 

03 

Total (N) ., . 

03 



Applying acclioa 11 j Tho figure dotoimhiod for G roup X from Form 6 was 6.7 
per centj 0,7 por oont of tlio total moii (03) taking this particular oxamination is6| 
It is scon thnt tho oxnminntion scoro of 23 was Attained or bcUored by 0 mso; 23is 
the average standard examination score of Group X. 



THE SIGMAS OF COMBINED DISTRIBUTIONS 
CALCULATED FROM SIGMAS, MEANS, AND 
FREQUENCIES OF COMPONENT DISTRIBUTIONS^ 

C R GARVEY 


National Scholar in Child Development, University of Minnesota 


It is sometimes necessary to compute for a senes of measure¬ 
ments, not only the mean and standard deviation of the series as a whole, 
but also the means and sigmas of several fractional distributions, 
components of the total or general dista-ibution The labor of calcu¬ 
lation IB thus doubled. If it is necessary to fractionate the data on 
more than one basis, «e, into more>than one system of fractional 
distributions, the labor involved is multiplied by the number of such 
independent systems of fractionataon plus 1 (the general system of 
parameters). 

Obviously, this increase m labor can be kept down m the case 
of the means, by finding the smallest fractional means first and using 
them to compute weighted means for the others Where x *= each 
measure and $ = the mean of N such measures, the formula would 
be 






( 1 ) 


m which subscript 1,3 refers to a distribution composed of distributions 
1 and 2. In practice, one operation is saved by using the form 


^i.s =«= 


Sail -|- Sxi 

Ni + W, 


( 2 ) 


hn which S indicates summation. 

This procedure is familiar to everyone. The present purpose is 
to extend it to the calculation of the standard deviations The writer 
wishes to claim no priority for the following original formula, its 
essential features having been given in a similar one by Yule many 
years ago But since a survey of such frequently encountered texts 
as those of ICelley, Garrett, Thuratone, Fisher, Rugg, and Pearl 
indicates that the method Is not in general use, it is thought worth 
while to present it here. 


1 The writer wiahoa to thank Dr HoTence L Goodonough and Phillip J. 
Union for reading the manusoript, without imposing any responsibility upon either 
of them 
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Where A x ~~ x 


When d = X ~ ax and ax ~ arbitrary mean 


fSd^ 
V N 


Now 


Sd 
^ ~ N 


then 


/W /SdV 
~ \l N \n) 


When as = 0, then d = x, and 


Sx* /SxV 

V iV \n) 


but 

Sx 


N ~ 

BO 

a 

and 



fS^ -a 

^Vlv 


2 -SX* 

- iv ' ^ 


(3) 


This is essentially the formula given to his students by the late James 
Arthur Harris (published in 1910),* and the one pointed out by 
Beardsley Rum! in 1916 ® 

Transposing and assigning subsonpts designating fractional dis¬ 
tributions, we have 

= (Ti* and - ^ 2 ^ - ci^ (4) 

iVi Ni 


^ The Antlimctic of the Produet Moment Method of Caleulating tho Coefficient 
of Correlation Ain^ncan Natiiraltat, Vol XLIV, 1010, pp, 093-690; eflpeoially 
696f 

* On the Computation of the Standard Deviation Payehological Bulletin, 
Vol XVIII, 1916, pp. 444-446. 
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By summation and from equations (1) and (2) we have 


4- 


x \2 ~ < r \,2 


( 6 ) 


In machine calculation a table is set up, in which the rows are num¬ 
bered to correspond to the aubsorlpts m the formulee, and which has 
the following eight column headings: 


1 

2 

3 

4 

5 

6 

7 

s 

Sx 

1 

N 


II 


Sx^ 1 
N 

m 

ff 


Divide the data into fractional distributions of the greatest com¬ 
mon denominatoi, so that any desued combined distribution can be 
made up from these fmctional distributions without further sub¬ 
division. Sum all the measures in the first small distribution and 
place the sum opposite subscript 1 in column 1 Place the number of 
measures in column 2 Square each measuie (from a table), sum the 
squares, and place this sum m column 3 The lest of the table is 
self-explanatory, each subsequent entry being derived from previous 
entries Completion of a row of entries to column 8 fulfills equation 
(3). The mean and sigma of a combmed distribution can be obtained 
by summing columns 1, 2, and 3, and calculating the entries foi sub¬ 
sequent columns fiom these sums. Any simultaneous portion or 
portions of these first three columns can be summed, and thus any 
desired distribution can be combmed from the appropriate fractional 
distributions. This fulfills equation (6) for any desired combination 
of subscripts 

In reviewing Iiteiature oi in other cases where is not given we 
need a formula using sigma mstead Prom equation (4) 


Sxi^ 

Ni 


— ai® = <71® 


transposing and multiplying by Ni gives 

= (<ri® 4- Xi^)Ni 

similarly for Sxz'. Then equation (5) becomes 

((Ti® 4- 4- 4- _ 2 ^ n 

iVi + ''' 


( 6 ) 
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Substituting the value of £ 1,2 from equation (1), and extending to 
include n fractional distributions, we have 


iVi + JVs -f • ’ N 


{Z))Ni + (f2)JVa + • • (5n)A^n 

Ni + Ni-P . 


r. (7) 


This IS comparable with Yule’a equation (7)/ 

N a^ = S(JV« ■ + :S(N^ ■ d„'^), 

except that here, equation (6), we use the fractional means themselves, 
whereas Yule uses the deviations di, dz, of these means fi om the general 
mean ®i, 2 , . „• Where these moans are small they may as well be 

used directly. Where they aie extremely large, the deviations are more 
easily used Experimenters should always report N along with x and 
sigma, so that their data can bo included in a suramaiy, and so that 
reviewers can actually review the author's work, instead of being 
limited to merely quoting the author’s conclusions. Of course, if a 
reviewer combines measurements made by separate authors, he must 
examine the comparability of the conditions undoi which the separate 
sets of measurementB were taken, just as he must in case of sets of 
data taken by the same author or by the leviewer himself 


‘ "An Introduction to tho Theory of Statistica,” 0th ed , London, 1029, p 142, 



A NOTE ON THE DEFINITION OF THE HARMONIC 

MEAN 

EUGENE SITEN 
Kwang Ilutt Univeraity, Shanghai 

The writer has found that students completing an introductory 
course to statistical method often have a very hazy notion on the mean¬ 
ing of the harmonic moan. While they can. make computations 
according to the formula, and even remember that its application 
has to do with the calculation of average rates, they seldom appreciate 
the problem in its comprehensive setting They often fail to see that 
the correct use of the formula depends upon the joint operation of 
two factors: The way in which events take place and the way in which 
records are made. 

As the harmonic mean m educational psychology usually relates to 
the question of time and work, we shall take an illustration in this 
field. A group of students competing in addition may be required 
either to work during a uniform amount of time or to finish a uniform 
amount of work. Usually, records are made of the amount of work 
finished in the given time, or of the amount of time necessary for the 
given amount of work. The anthmetio mean in the two cases would 
correctly give the average woik per unit time and the average time per 
unit of work, respooUvely, For purposes of comparison, we can use 
either one with the reciprocal of the other. The harmonic mean is not 
called for, 

Sometimes, however, data are given in terms of time per unit work 
when they are derived from a constant amount of time, or on the other 
hand, in terms of work per unit time when they are derived from a con¬ 
stant amount of work. In both cases, the arithmetic mean would be 
incorrect, and the harmonic mean should be used instead ^ 

The writer has proposed a definition of the harmonic mean as a 
special case of the weighted arithmetic mean where the weights are 
equal to the reciprocals of the measures ^ The true average height of 
man is not given by an unweighted anthmetio mean of the heights 

’ If m the foregoing wc substituto price foi rate, money for work, and commodity 
for time, we have a problem most frequently found in. the field of busmoas and 
economics 

* "The Foundations of Experimental Paycliology,” edited by Carl Murchinson 
Clark University Press, 1029, p. 839. 
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of cliffotoiU groups by race, rceidonco, or political afRlialion, becouae the 
groups vary in wzo and should be given diKereiil weights in proportion 
to the population in ouch gioup. Siinilarly tlie umvoightocl arith- 
raetic moan of a scries of i ates for a imifomi amount of work la incorrect 
bcoivuBC Uu' varying rates do not operate for the same length of time, 
and needs to bo weighted accordingly. CUcarly the length of time for 
wlUoh each rale operated is proportional to ila reciprocal, and therefore 
the correct moan is derived by weighting each rale according to its 
reciprocal This is precisely what llio harmonic mean is. 

It IS the opinion of the writer that the proposed definition leads to a 
more systematic and moio comprehonsivc conception of the harmomc 
moan, Ho has found it of valuable assistanco in clarifying tho mmd 
of such students as are apt to bo refractory to other methods of 
approach. Matheinalically it is of course equivalent and reducible 
to the usual definition, as the reciprocal of the arithmetic mean, of the 
reciprocals of tho measures i 


HM 



^{l/X) S(l/X) 


N 

S(l/X)‘ 



NOTE ON THE STANDAED ERRORS OF THE 
STANDARD ERRORS OF ESTIMATE AND 
MEASUREMENT 


CHESTER E KELLOGG AND KENNETH W SPENCE 
MoOill UmvorBity 


In the course of research on the reliability of the high-relief finger 
maze, recently coraplelod by the junior author of this note, and to be 
published soon as part of a comprehensive study, occasion arose to 
compare the standard errors of measurement of intelligence tests and 
various methods of scoring maze records In order to have a check 
on the validity of the conclusions drawn, we derived formulas for the 
standard errors of these and related measures. 

It might naturally be supposed that the standard error of a stand¬ 
ard error of measurement could be determined, as in the case of an 
ordinary standard deviation, by dividing by In the case of the 

standard error of ostimate, SD„i = SD(1 — the corresponding 
formula docs hold good For taking differentials, we have. 

dSD,.. = (1 - r')>«dSD - 


Squaring, summing, and dividing thiougli by n, 

SD\, = (1 - ,=)SD“, + - 2rSD,„aSDrSD., 


Assuming approximate noimality, and using formulas 32a, 108&, and 
125a from Kelley’s “Statistical Method,” this becomes: 


(1 - r2)SD2 , SDh*2(l - r^y 2»SD X 9 (1 - r^) SD 

2n ( 1 - 72 )„ 2 W ^ tiH ^ {2ny^’ 


which 1 educes to (1 — ?®)iSD“/2n 
Accordingly, 


SAa 

eat 


SD(1 - SD„, 

(2n)M 


Q.ED 


Similarly, for the standard eiroi of measurement, 
= ^SD(1 — wo have, taking differentials 

dSD„„ = (1 - r)yidST> - 
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Squaring, summing, and dividing through by Uj 

= (1 ' + ig^T) 


-^2SD(1 - >■)« X J-,., X SD, X 2(r^ 


(1 - »-)SD* , SD^l - r»)* /SD X r ^ (1 - r’) SD \ 
2n~ 2W ^ J 

which reduces to SD®(1 — r)(3 — r’*)/4n 
Accordingly, 

= SD(1 - 

„ SD„.^ (3 - 
(4n)^^ 

To facilitate calculation of the SDad,„^, we have tabulated 
representative values of (3 — j**)^V(4»)^ 



Although it is not likely to be much in demand at present, we have 
also derived a formula for the standard error of the standard error of 
estimate of true score, SD„.i SDi(ru — (Kelley, formula 

1600 

dSD,,. = + (r - r’)«dSD. 
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Squaring, summing, and dividing through by n, 
, = SD»SD^|p-^ + (r - r*)SD»., 


= SD2 


+ 2SD(r - r^yi{rr^SJ),W,, - 

(1 - 4r + 5r^ + - ir* - + 2r^) 

4n(r - 7 “) 


2r n.dSDrSD,d) 
2(r - r2)H 


Accordingly, 

1 “ > (inr{r ~ ;•=))« 

„„ (1 - 3r + 2r’ + 3r* - r* - 2r'‘)W 

~ ' {inr(r - r^))ii 



NEW PUBLICATIONS IN EDUCATIONAL 
PSYCHOLOGY AND RELATED FIELDS OF 
EDUCATION 

CONDUCTED BY FRANCES M. FOSTER 


Educahonal Psychology, by Moni'oe, DeVoss find Reagan New York. 
Doiibleday Doran, 1930, Pp XIII -f 607. 

Piohlems in Educational P^dioloqy, by Gifford and Shorts. New 
York: Doiibleday Doran, 1930 Pp XIV 4- 728. 

These volumes are two from the excellently planned Teacher 
Training Series, edited by W. S. Monroe, one of the authors of the 
Educahonal Psychology The second text listed above was designed to 
supply companion readings to any basal text m educational psy¬ 
chology, but the authoiB acknowledge that they had the Monroe, 
DeVoss and Reagan text priiiBipally in mind when they planned 
their work. 

The Educational Psychology is a wcll-constructcd book exhibiting 
many exccllont features. In the selection of the aubject-matter a 
wise catholicity has been shown. The topics included are—The 
Physical Mechanism; Human Bcsponscs to Stimuli, The Learning 
Process; Learning in School Activities; Transfer of Training; Intelli¬ 
gence and its Measurement; Measurement of Achievement, Indi¬ 
vidual Differences, CharacteiisUcs of Children at Different Pedagogical 
Levels, The Psychology of Elementary-Sehool Subjects, The Psy¬ 
chology of High-Sohool Subjects; Mental Hygiene; and How to Study 
Pupils. Such a list can be made strong meat and in then efforts to 
keep the text at an elementary level a few of the topics neccssaiily 
become a little obscure. The "limit of improvement" is an illustra¬ 
tion of this. Apparently the authors take up the position of behoving 
m limits for manual habits only; the acquisition of knowledge may 
proceed with ever-increasing facility 'Which, of course, is a mis¬ 
interpretation The authors have also hunted with the hounds and 
run with the hares in respect to Bubjoctive and objective observations 
although, as aoientiats, they have emphasized throughout their volume 
the data obtained from carefully cohtrolled experiments The beat 
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featuie of the book is the consistency with which technical terms have 
been used. When, for example, they wish to speak of intelligence 
derived from the use of a test as distinguished from intelligence as a 
theoretical concept they use '^intelligence as measured” and thus get 
nd of any ambiguity. The Learning Exercises for the reader at the 
end of each chapter are truly exercises to promote further learning 
and are commendable. 

The Pi oblems in Educational Psychology is an anthology of excerpts 
or readings from works of 192 authors Thorndike and Woodworth 
are quoted the most frequently, and justly so. The selections appear 
to have been made more carefully than those of previous compilers 
such as Skinner, Gael and Skinner. By listing in each chapter 
“Suggested Problems” and “Supplementary Learning Exercises” 
some attempt to justify the selected title has been made. 

Both volumes aie well printed and strongly bound, and both are 
remarkably free from typographical errors. The reviewer wishes 
them the success they deseiwe. P, SANDiroRD. 

University of Toronto. 


Minnesota Mechanical Ability Tests, by D. G. Paterson, R. M. Elliott, 
L. D Anderson, H A. Toopa, and E. Heidbreder Minneapolis: 
University of Minnesota Press, 1930. Pp. XXII -p 526. 

It 18 a genuine pleasure to study the methods—so thorough, so 
cautious, and often inventive—^which characterize this excellent and 
important investigation, Within recent years there have been 
published few other studies of similar thoroughness, so insistent on the 
accuracy of the instiuments of measurement, so critical of their 
validity There is leason to think that with this type of investigation 
(one would like to name those few others of equally fine caliber!) the 
measurement of human behavior has, within the last few years, 
achieved one more significant step in its advance towards recognition 
as an exact science In the field of mechanical ability undoubtedly this 
particular work is fundamental. 

The authors act out to mvcstigate the field of mechanical ability 
to determine adequate answers to the two main questions (1) Is 
“mechanical ability” one ability or many? and (2) How is it related to 
other traits such as verbal intelligence and motoi ability? 

By force of circumstances, similar to those experienced by investi¬ 
gators m the field of measurement of verbal intelligence, it became 
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necessary to define mechanical ability as **that which enables a person 
to succeed in a definitely restricted range of vocational and trade 
school courses ” 

A survey of literature in the field yielded twenty-four tests relating 
to mechanical ability These were administered in a preliminary 
investigation to two hundred seventeen boys, all taking shop-work, in 
Grades VII and VIII m a junior high school. Nearly all of the tests 
were readministered after a suitable period of time, thus yielding a 
measure of reliability. 

The criterion selected was shop grades, determined as objectively 
as possible in terms of quality of work, quantity of work, and informa¬ 
tion displayed in examinations. 

The scores on every test were then correlated with (1) the criterion 
scores and (2) the average scores on two verbal intelligence tests 
Seven tests, yielding the highest correlation coefficients with the 
combined criterion, were ecloctod to comprize the final battery 

b»tt ^ batt -^crll + latBll b»tt 61 ). 

The TcUabilily coefficierds of these seven tests ranged, however, from 
65 to .80. By lengthening some, and imposing a time limit on 
others, the coefficients were raised, thooretioally at least, to range from 
.80 to .93, expectations closely approximated in the final experiment. 

In the oxpenment proper this battery (now known as the Minnesota 
Mechanical Ability Teats) was administered to one-hundred fifty 
incoming boys in the same grades at the same school. In addition, 
thirty-six other measures were determined, covering academic success, 
previous mechanical experience, interests, motor ability, anthropo¬ 
metric measures, social and economic status, and home influences 

The validity of the criterion was determined on the basis of objec¬ 
tive standards of judgement—the mfonnation factor on the basis of 
objective tests, and the quantitative factor on the basis of production. 
The careful construction of objective rating scales yielded a quality 
criterion (3:3 to 6.6 judges, depending upon the function measured) 
of reliability over ,90 The reliabiliUes of the different shop cnlenon 
approximated .80, The coirelations of the individual tests with the 
quality-quantity criterion, however, were so low that the quantity 
critcnon was abandoned. The validity correlation between battery and 
quality criterion alone loas .66 The validity of the battery in respect 
of each individual type of shop work was found to be about as good as 



Next) Pubhcaiions 319 

that of most standard intelligence tests in respect of success in indi¬ 
vidual academic subjects 

Analysis of results in accordance with the principles of Spearman 
suggests that specific factors rather than a single general factor 
characterize mechanical ability There is, however, some evidence of 
the presence of group factors Four-factors, on the other hand, were 
found to be unique namely intelligence, height, agilily, and mechani¬ 
cal ability. 

The authors thus conclude m the mam (1) that mechanical ability 
as here defined is a unique trait, (2) consisting of a number of specific 
traits having possibly group factors in common, 

The reviewer would have felt entirely satisfied had the three 
following questions been answered (1) During the actual testing 
process what control was there over the possibilities of leakage of 
information concerning the tests? 

(2) In 90 far as the entonon fails to measure “originality” does it not 
fall short of what, with occupational reference, might be termed 
mechanical ability? (8) To what extent are these findings in agree¬ 
ment with those of a recent investigation into “mechamoal aptitude” 
by John W, Cox, one of Spearman's pupils? 

Comment on the valuable investigation here reviewed cannot be 
allowed to pass without reference to the excellcnoe of the binding, 
printing, and general layout of the volume 0 L. Harvbv 

University of Texas. 


Problems of Science Teaching at the CollegeLevel, by Archer Willis Hurd. 

Minneapolis, Minnesota* University of Minnesota Press. 

In these days of educational innovations and unproved panaceas 
for college ailments a bit of cautious, scientific investigation in the field 
of higher learning is like fresh water to the thirsty For some years 
college men have been protagonists for educational experimentation 
and research in the elementary and secondary schools. Student 
achievement and that relating thcieto has been measured and probed. 
Some of the most loudly advocated new methods of teaching have been 
partially examined However, perhaps because the beam seemed 
bigger in the other fellow’s eye, there has been comparatively little 
scientific investigation of teaching problems m college. It seems quite 
fitting that one should arise from the examined group and now lead 
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some study of a similar natuic in the realm of those who first made up 
the game 

The work reported concerns itself with the following problems: 
(1) What differences in individual achievement in the study of anatomy 
is produced between those who work in groups of two and those who 
work in groups of four on a cadaver? (2) What la the effect of limiting 
the tune given to laboratory work in human physiology or of partially 
replacing the laboiatory work with library work? (3) What is the 
effect of eliminating laboiatory work in the study of “Mechanics”? 
(4) What effects has class size on individual achiovomcnt in the physics 
courses of “Heat” and “Electricity and hlagnetism”? (5) What 
influence does a high school course in physics have on the achievement 
of students in college physics? 

The details of the conclusions drawn from the studies arc, naturally, 
of special interest to college teachers of anatomy, physiology, and 
physics. The main finding likely to be of general interest is that 
class size in the courses investigated appears to have no influence on 
student acluevemcnt. In the words of the author, “Achievement 
seems to be more a matter of individual incentive, capacity, and effort.” 

Di. Hurd has nicely evaluated his work when he says, “The 
studies . find their greatest value m actual, concrete illustrations 
of techniques in cdacationol cxperimontation. They represent 
attempts to settle problems of teaching by methods of experiment used 
in science.” The discussion of the outstanding references in the 
excellent bibliography and the section of the conclusions on suggested 
techniques for this typo of expenmcntation strike the reviewer as 
being particularly noteworthy Lkonaup B Wheat 

Teachers College, Columbia University. 



THE JOURNAL OF 



Volume XXII 


May, 1931 


Number 5 


THE ASSOCIATION FACTOR IN INTELLIGENCE 

TESTING* 

S TOLANSKY 

Fellow of Aimstrong College, Newcastle-upon-Tyne 
Introduction 

A good dcEil of work has been done on tho lohability of intelligence 
tests and tho constancy of IQ but very little on the nnalysis of lesponse 
error Holzmgeri considois n response error (5) as due to fluctuations 
in offoifc, emotional status, concentration, etc. Ho finds that this is 
roughly normally distnbutod. Stenquist* observes that, if the Terman 
tests are repeated on a group, seven per cent are twenty points out, 
and this is probably duo to response error, An account is given in this 
paper of an investigation on the association factor in intelhgonoe 
tests. Tho tests seleotecl were from the American Army a Test, 
admittedly somewhat old Instead of allowing, say, the usual two 
minutes for a test, a modified technique was employed. Tho test 
was covered up The first question uncovered and the time taken, 
to answer it was noted with a stop watch reading to one-tenth second 
The next question was uncoveied and the tune taken This procedure 
was repeated to the end of the test. Very little time was spent in 
covering and uncovering and the timing errors cancel out. Only 
those questions done in the time stipulated in the test are considered 
for tho score By graphing times against tho number of the question 
it IS strikingly shown that cei Lam questions (different as a rule foi each 
person) give abnormal times There are thiee possible causes of 
delayed response to a question. They are. (1) Ignorance of facts; 


* I wiah to thank Mi' Voinon Blown foi assistance m the preparation of this 
paper 
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(2) inability or partial inability lo answer, through WGakuess in 
reasoning; (3) delayed icaction due lo an emotional association. 

In a good inteiUgoncQ test (1) is reduced to a minimum and the 
cause (2), which is that concerned with intelligence, becomes important 
However (3) cannot be neglected by any means Jung^ has shown in 
his word assQGiation experiments, that woida involving an emotional 
factor take a longer timo for a response than do words which do not 
arouse such a factor I have found as a rosull of expcnence that a 
delay up to ten seconds in ordmaiy W'orcl association is sufficiently 
common to be considered normal Suppose then that in a test, which 
has not been completed m the stipulated Ume, there arc words or 
ideas which call up associations emotionally toned, then, iricspective 
of iiiLclhgciice, delays wiU talce place over these. The net result is to 
reduce the IQ, for had the tunc not been uselessly absorbed more 
questions could have been answered There arc, of course, associations 
to Gvory question. These can be classified into the useful, helping to 
solve the problem, and the useless, of the Freudian oi Jung type. If 
all the questions liavo been completed m the time, thou the delays do 
not affect the number attempted The possibility of useless associa¬ 
tion ns purely accidental, depending on previous experience, and this 
may partly account for disagi’eemonts lu reliability and IQ constancy 
observatvona 

EXPEIlIMEVNTA.n MeTIIOD 

Two testa wore seleetod, a true-false test and a multiple choice 
test. Both were given to five women and five men college students 
The rcacLion times were taken and the testecs were carefully watched 
The questions taking abnormally long time were selected and the 
testee'a attention drawn to thorn In some the delay was easily 
explained The tesfceos immediately admitted lack of knowledge, or 
actual difficulty. The otheia, which predominate, delay was due to 
useless association The questions were dealt with individually 
and a regular psychoanalysis earned out In every case it was found 
that the cause of the delay was due to associations of emotionally toned 
complexes, some going back many years, sonic sexual, and some being 
repiossfid incidents of an unpleasant natuie, In piaciically eveiy 
case the examinee was hardly awain that the time taken was long, yet 
in some instances a change from an aveiage of six seconds to a delayed 
time of seventeen seconds took place. It was often easy to tell from 
facial expression that the emotions wcie distiiibed 
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It has been oonsideied advisable to reproduce the two testa since 
frequent reference will be made to them To illustrate tlio effect of 
useless association two tests have been selected at random from the 
twenty and the detailed analysis given The results of the twenty 
tests arc shown in Tables I and III and conclusions drawn from them 
are recorded 

Desen-phoiX of Tesla 

Test I 

Type, multiple choice 

Sixteen qiicstiona nro to be answered 

Time fillowcd—niuety aeconda. " 

SuUcst 

1 It iH Wiser to put money nsido and not spend it all so that you may: (o) Pre- 
pniQ foi old age and sickness; (&) collecb all the diDiercnt kinds of money; 
(c) gamble if you wish 

2. Shoes aio made of loathci beeauso* (a) It is tanned, (h) it is tough, pliable and 

waim, (c) it can bo blackened 

3. Why do soldiers wear wiiat watches rather than pocket watches? Becauea 

(o) They keep better time, (b) they arc Imidcr to break; (c) they arc handier. 
4 Tho mam reason why stone is used foi budding pin poses is because, (o) 
It makes a good appearance; (h) it is strong and lasting; (o) it is heavy 

6 Why \a beef better food than cabbage? Beeauso: (o) It tastes better; (L) it is 

more nourishing, (c) it is harder to obtain 
0 If somcono docs you a favour what should you do? (a) Try to forget it; 
(b) steal for lum if ho asks you to, (c) return tho favour 

7 If you do not get a letter fiom homo ivhich you know was written, it may be 

because (a) It was lost in tho mails, (b) you forgot to tell your people to 
write, (c) the postal service has been discontinued 

8 Tho mam thing fnimcis do la to (a) Supply luxuries, make woikfoi the 

unemployed, (c) feed the nation 

0 If a man who can’t swim should fall into a iivci he should (a) Yell for help 
and tiy to sciamblc out, (&) divo to tlio bottom and crawl out, (c) lie on his 
back and float 

10 Glass insulators aic used to fasten telegraph wires beeauso (o) The glass 
keeps the pole fiom being buiiied, (6) the glass keeps the current from 
escaping, (c) the glass is cheap and attiactivc 

11. If youi load of coal gets stuck m the mud what should you do? (o) Leave it 

theio; (fi) get moic hoises oi men to pull it out, {«) thiow off tho load 

12, Why aic cinnmals locked up? (a) To protect society, (i) to got even with 

them, (c) to make them work 

13 Why should a maiucd man have his hfc insured? Bccauao (o) Death may 

come at any time; (&) insurance companies aio usually honest, (c) his family 
will not thon sulTci if he dies 

14 In leap yonis !Fcbruary has twenty-nine days because (o) Pebiuary is a 

short month, (li) Some people are born on Febiuary 29, (c) otlierwiso the 
calendar would not como out light. 
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15. If you are held up and lobbcd m a atmngc city you ahould (o) Apply to the 
police foi help, (i>) ask the fiist iTinn you meet foi money, (c) boiiow some 
money at a bank. 

16 "Why should wo hnvo Congressmen? Because (a) Tlio people must ho ruled; 
(b) lb ensures tiuly vcpicscntaUve government, (c) tho i>eople me too many 
to meet and make their laws 


ExyEMMPtJ'SAli Rustjliis 

In a test of this nature a valuation in time for each subtesfc is 
expected because of the vaiymg times required for reading, etc. 
This, liowevcr, is systematic and aflfccts each person to a roughly equal 
degree Different rates of reading in different persons will seriously 
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affect the result, which is a bad fault in the test. The times taken 
by the ten people A to / are given in. Table I The subtests completed 
in ninety seconds by each individual are shown above the black line. 
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The total times are given to the neaiest second and below tbs the 
score obtained A. full analysis will follow later The asterisk inch- 
cates useless association, the other long times arc accounted for under 
headings (1) and (2) at Ihe beginning of this article 

The full analyses for A will now be given, id is a woman graduate 
twenty-two years old. It is convenient to classify the first pait of 
each question as the statement and the three choices as I, II, III 

1 Pioblerti (1) takes 10 Beconids Statement causes the following associations 
"Foresight—inaumnce—doctor—illness—child—insuiauco." A’b sistei is ill and 
the doctor called today Ho is the cloctoi of a Indy friend who maiiied nn aihng 
husband. The luiaband died recently and the doctor had asked how tlie wife 
existed and woa told by A that the husband waa heavily msuicd (see question) 
A child was bom to the lady cluung the last illness of the father A was auipnsed 
and cynical foi the lady claimed she had no sex knowledge and confided m A tliflt 
she did not sleep with her hnaband, a point which stiuok A very foioibly. 

2 Pioblora (7) takes 9.2 seconds and clioicc II gave “lack of letters—uiging 
at homo—disappointment with mothoi—upbiaidmg " Two years ago A was in 
Franco for some montlia and hoi mother hnully ever w'roto hci although her sisters 
did. She was disappointed and complained on icturmng She often blames her 
motlier for failute to write. 

3 Problem (13) takes 7 8 seconds, the woid "insuicd" giving, "insuranco- 
agent—wife—peroxide—Peter.” There was a long pause after this A said 
"Oh daslil" when tho word "insurance-ngcnt” slipped out That day her 
mothci told hor she had seen an msuiancc-ngcnt who had Tnnined a fair-haired 
gul and now had a child, Potei Some years ogo A thought this man keen on her 
(note the dopreoiatiug, poiliapa 3 caloua, romaik of "pcioxide” lefoimig to tho 
wife’s fair hair) A said she was pleased he was now settled as he is a bit of ft 
philandeier She was ft little too anxious m disclaimrng anything but fiicndly 
regard 

4 Problem (14) takes a long time, II 0 seconds, choice III gives two distinct 
tiftins of association 

1 "Ilcfoim of Calendar—Juhug Caesar—month of August (named after 
Augustus)—Harvest Festival in August” A stopped and related the 
following, She lemembercd when thiee yeais old falling off a seat in 
church during a Imivest festival Someone picked her up and threatened 
to steal her from her parents She even lomeinberB the dicaa she was 
wealing at tho time • 

2. "Chftngo in Calcndni—St. Cuthbert’s Church—vicar—scuivy trick ” 
At the above chuioh A had taken a prominent pait in social life On 
removing she had neglected to say farewell to the vicai and thought this 
very bad The vicar wag very conseivativo and would certainly object to 
the iGccnt proposal foi fixing the dato of Bnatci 

6 The Inst question took, an abnormal time—17 seconds. Choice II caused a 
whole group of aesocintions connected with the fact that A believes piesont day 
government is entirely undemocratic 
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Thia couoluclca the analysis, AUogelher thirteen ciucstions were 
done in time. Thia is indicated by the line at thirteen in Table I. 
Tabic II, A gives a detailed result for tostoc A. ‘Useless association 
IB indicated by the figure 1 in Tables II and IV, and where the time 


TAnm II 



is long, due to the absence of useful association only, this is shown 
by a figure 2.* When the question has been wrongly answered a period 
18 given Thus !■ indicates a wrong answer and usolcsa association. 
.4 thought problem (10) was of a technical nature, was afraid, and 
guessed, wrongly Eleven marks were scored. The nvei'age normal 
time for quOBtionB, other than thoBC marked by a 1, i8 five eeconds. 
The five type 1 associations taking the long time of sixty-four seconds, 
t.e, thirty-nine above the nveiage Since thirty Boconds more than 
the time allowed was taken, it is obvious that but for the useless 
association 4 would have completed the whole test, and obtained three 
more marks. Tliirty-one per cent of the questions which me emotion- 


* HcicTred to as types 1 and 2 Intei 
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ally toned take sevonty-ono per cent of the time allowed From the 
analysis given thcie is obviously no doubting the strength of the 
emotional tone and its real effect. As seen from the table, A is not 
the most extreme case. 

The second test, •which was given to the same ten people, is as 
follows It IS the true-false type. Sentences liad to be arranged into 
sense and marked true or false There are twenty-four questions 
and one himdicd twenty seconds arc allowed. A mark is deducted 
for each error, as usual. 


Test II 


1 Lions ationg aio 

2 Houses people m live 

3 Days there in a week eight aio 

4 Leg flics Olio have only 

6 MonthscoLdost aio siunmoi tho 

6 Qotton sea water siigai is fiom. 

7 Honey boos flowors gather tho bom 
8. And cat good gold silver to arc 

0 Ficsidont Coluinbus flisb tho was Amorica of 

10 Making is bread valuable wheat for 

11 Watoi and made aio butter fiom cheese, 

12 Sides ovoiy lias four tiianglo. 

18. iCvoiy times makoH mistakes person at 
14 Many toes Angola as mon as have 
16, Not cat gunpowdci to good is 

16 Ninety eanal ago built Panama years was the 

17 Live dnngcious is near a volcano to it 

18 Clothing woithlcss arc and foi wool cotton 

19 As sliQotB aro napkins used never 

20 People tuisfced mtemperato be always can 

21 Employ debatcis uony iievoi 

22 Certain some death of moan kinds sickness 

23 Envy bad malice traits and aie. 

24 Repeated call foi com Lesies associations 

Full results arc given in Tables III and IV Full analysis is given 
for C who has tho best mark and finished in one hundred seven seconds. 
As usual, a maik is subtiactcd from the total for every error, to correct 
for guessing C is a science student (man) aged twenty. 

1 Pioblem (10) takes 5 4 seconds Associations wcic “cornfield—fresh air— 
house—removal ” Five ycais ngo C had to leave Jus house, the family going to a 
country house next to tohal was then a coinfield Ho is now of tho opinion that the 
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change wa^ an advantage, but was dovibtfnl then IIo lecaUccl hia nnxed fcelmgq 
nb going to hvo in bho counity 

2 Pioblem (10) tnkca 6.4 bwhuK giving “napkin—set table—Chiislinfts— 
Bpillcd wine " Some veais ago lie had spilled a glass of ^Yn\c with lus napkin at a 
ClnistmnH dninci at home CJhvistinfls w Iho only oeca&iou on winch ho gotswmo, 
It was not joplaced, ho thought it vciy wasleCiil, lUmcd a tablecloth, and the 
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whole family laughed at him Ho vividly lecalls tho mcidout The mental 
cljstinbnnco m tho tost was ationg ainco ho also answoicd ivcougly, much to liis 
siirpiiso, on lator lending Ins ttnswora 

S. Pioblcm (23) takes 8 6 sceonds giving “bnd temper—tonchoi—blameless " 
Thico years ago C was a pupil tcnchCT in a school. The class leaohoi wns bad 
tempered, often striking children who were blamcloss Tins affected him a good 
deal. 
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4 The lasb pioblcm takes 0 2 seconds Associations aic “Nurse—sistei-— 
motliei Last auinmer lus sister cut liei foot iii the sticot on some glass A 
nuise living noniby had toiuted it Last month the luirae fell ill and C’a mother 
repaid the kindness by tending hei foi Ihieo weeks C thinks the mnso fully 
deseives this comtQsy 


TATihV. IV 













1 Totals 

Pioblcm.s 

A 

D 

C 

D 

E 

F 

G 

H 

/ 

J 


—— 













1 

2 

• 

1 



■ 











2 



■ 











3 




• 

1 



1 

1 


' 2 


1 

4 







' 1 

1 



1 


1 

S 



■ 











6 



■ 






B' 





7 1 









B 





8 

1 





1 


1 

B 


B 



0 





2 




B 

1 2 


2 

' 1 

10 



1 1 , 


; 1 




B 


' 2 



11 


2 

2 ' 


2 

2 


2 

B 




1 

12 



1 











13 

2 



1 


II 

1 



3 



S 

14 



2 

1 


B 

1 

1 






15 







. 






2 

IQ 

2 


2 



2 

2 

2 

2 



6 

0 

17 














18 







1 




B 


3 


n 


mm 

1 


1 

1 



1 

B 


6 

20 

II 


2 



1 

1 




3 

1 


21 

n 

IH 

2 


1 


2 




3 

2 

1 

22 

■ 





1 

1 

1 


1 

4 


1 

23 

■ 


1 




1 




2 



24 

H 

2 

1 



1 

1 

1 

1 


5 

1 


Total 1 

5 

m 


B 

B 

7 

8 

5 

5 

2 




Total 2 . 

2 

2 

i 

fl 

a 

2 

2 

2 

1 

2 





Theie weie four type 2 questions In (14) C wondered wliether 
or not thumbs wore included as fingers and stopped some tune. In 
(16) he took twelve .seconds, Ho did not know the answer but guessed 
rightly, In (20) and (21) he had to pause and consider before deciding 
whether they were true or false. 
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These two fully worked examples arc illustrative of all Very 
profound associations were met with in some of the tests. 7, whose 
avciage is about four, takes twenty-one seconds over the last question. 
Ilifl mind, he said, was a perfect blank. Analysis revealed a strong 
sexual complex No person completely escaped the effect. 

Discussion op llEbULTs 

Tables II and IV yield valuable conclusions. Consider Table II. 
The totals foi each individual are at the foot and for each question 
at tho side It is obvious that problems 7, 11, 13, and 16 have a very 
strong tendency to produce useless association. Eight out of ten 
persons have type 1 association in question 7. The mean time is 
8.8 seconds, while for the next question it is only 3.9 seconds Refer¬ 
ence to the list of questions shows these problems are almost certain 
to bring emotionally toned responses to anyone. Their content is 
such as probably to affect the average person; therefore this type 
of question, ought not to bo included in the test, since it lesults in 
errors This method then acts as a selective agent in improving tests. 
There are altogether thirty-one of type 1 and twelve of type 2 associ¬ 
ations Fourteen mistakes were made (neglecting problem 9) and of 
those nine are associated with type 1 and four with typo 2 delays 
It was often found that a strong disturbance resulted in a wrong answei 
as woll as delayed rcBponse There is very httle tendency to per- 
eeveration. This may be connected with the fact that a break occurs 
between each problem. Problem 0 is on amusing reflection on the 
authors of tho test Seven persons gave wiong answers; they insisted 
that tho answer given in the book was wiong; the times wcie not 
abnormal. In this test a certain amount of latitude has been allowed 
for different rates of reading. G only gets eight marks, but he is 
a very slow reader, only finislung ten. 

Now consider Table IV. Problem (19) is obviously unsuitable 
since seven people show associations of type 1 and there aio six wrong 
replies. Question (24) is unsuitable and (8) and (22) are doubtful 
(11) is of interest since there arc live associations of tho type 2 and as 
seen the question is actually somewhat inoic diihcult than the rest for 
townspeople (but not for country people), Pioblcm (16) has six 
of the type 2 associations and six wrong answers This is due to 
absence of knowledge since the exommoes are English and the question 
refers to America. In this test there are six and in Table II there are 
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eight questions ’which give no abnormalities of any description, ^ e , 
every one does them fairly quickly and gets them right. These are 
appaiently simple questions and the response time is small for each 
A sprinkling of type 2 is desirable, helping to eliminate the less capable 
Nineteen wrong answers woio given (if problem (16), which refeired 
to Amei’icn, is neglected). Of these eleven are type 1 associations and 
one type 2 

Conclusion 

It is apparent from a general smvey of the tables that the associa¬ 
tion factor is of real significance in affecting the rate of reply in a test 
In all four hundred questions were set Of these onc-hundied four 
take long limes Seventy-one of these aie due to type 1 and thirty- 
throe to type 2 associations. There is a marked tendency for wrong 
replies to occur with typo 1 delays Thus thirty-three wrong replies 
are made, twenty occuning with type 1 delays, and five with type 2. 
In many cases there is hesitation at the beginning of the test, the first 
question taking a long time. This is natural, and was not taken as a 
case of delay. Six out of the ten poisons would have answered more 
questions—and probably earned more marks—had it not been, for 
useless associations Anderson^ has shown that speed of response in 
word association diminishes very markedly as the age decreases from 
fourteen years to eight years. It i8 thus quite probable that the delay 
effects will become worse with tests applied to younger children. 
These delays are present in all mental testing and must affect scores 
and consequently correlations 

The method employed can be made use of as a weapon in the 
improvement of a test, by selection While the test used is not one 
of the later improved types, the conclusions are in no way invalidated. 
For any test which contains similai ideas to these (and most do) will 
produce associations The results indicate that an attempt should be 
made to draw up tests, in which a tendency to associate will be improb¬ 
able To show the effectiveness of this method of examining tests 
a curve is drawn in figuic 1 with the results of I and J superposed 
(Table IV). J has made no eriois due to typo 1 and has twenty-two 
marks, J’a tune is eighty and Z's tunc one hundred twenty seconds 
The curves are fairly parallel if the typo 1 delays aie not counted 
Thus a drop from (4) to (6), a rise from (15) to (16), then a diop to 
(17), following with a rise to (18) la common to both curves It is 
obvious that I and J are of about the same intelligence and actually 
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if jioi for type 1 oriors both would get twenty-two marks Questions 
(8), (JO) and (24) arc of especial inleiost, showing how quq person 
takes tliree and four seconds in ii normal responso, the ofchoi taking 
ton and twenty seconds in an abnormal responso. Emotionally toned 
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association, then, can act in two ways* (1) It can reduce the number 
of questions done, (2) it can produce wrong answers by disturbing 
the cmotiona 

To test the effect on correlation, a group of cxpciimcnts is now 
being conducted in conjunction willi Mr. Voinon Brown Tests 
are being given to a hundred childicn A group of oidinary tests, 
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involv.ng verbalism and likely to give aesceiations le bemg .ven 
and he,r eouelation dete,nnned. To the same children a gLup o 
the 'dhtoiate" type lest, largely geometucal in nature, is al c being 
given, and Uio.r correlation determined Since asso;ation is ^ 
likely heie, the eorielation ,s expected to be higher Results Jil be 
communicated latci. 
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TET11M)-DIL^FERENCES FOll VKllRAT. SUBTESTS 
llEEATIVE TO NON-VKllBAL SUBTESTS 

WrU^IARI HTKl'IIKNSON 
UmvciHily C’ollcgo, TiOiidon Uuivomfey 

Intuodvction 

Tlic prc&onC piipci couLiaues conmdci’aUon of (lain giitheicd from n 
population of 1037 girls to whom had boon appliocl ii “non-verbal” 
and a “vcibnU* gioiip tpst.**® 

The Spcaimnn Tbeoiy of Two Factors has l)ccn shown to fit the 
non-VGi'biU sublcst vnloicovrdaUons with exactness,' while the verbal 
subtests only approxiioutcly fit the Thcoiy We observed excess 
onor in the tetrads for the verbal aubteats, of amount about 0.015, 
and the many sources of oiror biought foiward l>y us wore inadequate 
singly to explain it At the concluaion of our previous paper,^ It was 
hinted lliat a summation of many small dislurbances might bo taken 
to explain the observed 0,015 excess error, but wo could suapcct, with 
at least equal loasou, that fuiUiov iidlucnccs might lie at woik in the 
verbal subtests. This latter suspicion, indeed, lins some support from 
data for conclation tables (not reported here) for iOO, 200, and 500 
sub-populations of tlic 1037 gii la, where the non-verbal subtosts showed 
nearly exact diminution of tclind error as the sub-population was 
mcicased while the verbal subtcsls uniformly showed excess error m 
the tetrads, no inattoi what the sizes of the sub-population 

Howevoi, the present paper is to bo concerned with intorcoirelaLion 
tables containing both non-verbal and verbal sublcsts, and new facts 
might be expected to cmeigc from the comparison that wo aic to make, 

Inteucoiiuislations and Tutiiad-differences 

Table I gives intcicoiielationa for the seven vcibal subtesta Nos 
2 to 8® and tho foui non-verbal subtesta Noa I, III, Y, and 
All were calculated for standard “normal” score distributions,' wcie 
calculated by the cliffeienco method of scores; and weic cheeked in tlie 
usual way, and at tho instigation of tho tetrad criterion Wo have 
used only four non-verbal aublcsts instead of the available eight® 
because n table containing all would bo unwieldy for tetrad purposes' 
But in a later table we use othci non-veibal subtests 
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We note m the first place that the batteiy of seven verbal sub- 
tests correlates 0.65 with the battery of four non-veibal. Assuming 
that other subtests would piovide correlations similar to those in 
Table I, a batteiy of very many verbal subtests would conclate 0 82 
with a battery of very many non-veibal sublcsis. There is shown, 
then, a laige measure of concomitance for the verbal and non-verbal 
abilities, a fact that should not be oveilooked when we turn to our 
main detailed intoi cst m the placing of both types of subtests in tetiads. 

We turn at once to this detailed examination of tetrads for Table 
I. The correlations with age show no diseiimination for the verbal 
compared with the non-veibal subtests (see Table and IP), and 
we continue without paitmlling out age correlation* Collection for 
age correlation usually accounts for at most 0 005 excess error in our 


Table I —Piiodoct-moment CoititBLATioNs, N = 1037 Girls 



I 

III 

V 

VIII j 

2 


4 

6 

8 

B 

8 

I 


4124 

3733 

1 

1 3207 

3737 

4217 

1 3273 

3878 

1 3899 

4004 

3470 

III 



4711 

3.508 

wmija 

1 3270 

3683 

' 3359 

1 3821 

3976 

1 4058 

V 




3378 


1 4145 

3908 

3826 , 

1 6029 

' 4986 

4797 

VIII 





2514 


2632 

2759 

mm 

3067 1 

3014 

2 







5580 

5085 


5845 1 

5883 

3 ' 

, 

1 




1 

4623 

5924 

5266 

5599 ' 

5106 

4 ' 








4474 

4693 

6019 

5046 

5 









5550 

6745 

6121 

6 











5220 

7 

8 




• 







5929 


tetrads We note that specificality might be expected for r^s, since 
subtests V and 6 are of analogy type 

Theie are 990 tetrad-differences for Table I, with value as follows. 

Moan of 990 tetiad-cliffeicncca 0 035C 

Obseived pe (conventional, mean X 0 845) 0 0300 

Theoietical PE (foimula 15A*) 0 0105 

Thus, the table shows eiior of amount 0 028 in excess of that attribut¬ 
able to sampling, and this is not noticeably diminished if tetiads 
involving are eliminated 

Of the various tetrads entailed, those for only non-veibal siibtcsts 
give sampling error values, and the tetrads for only veibal subtests 
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entail error of amount 0 018 (in exeehs of sninpling ci'roi, as found m 
the previous paper ® 'I'liis latter, spread over the 990 tctiad-differences 
would amount to just about 0 002 of t.lie 0,028 excess tluii ig actually 
obseivcd. The reiuamiiig teliadn, to be our enneem in the following 
pages, may be considered for convonicnce in gioupa of the following 
types; 

UiKi ~ 

? me I ' ? 1,1, ~ 1 mr,' U u, ~ (z,) 

*niii Uijij ^Miri ~ I' (y) 

rninj J III, “ rn,n Uiii, =* I"' (a;) 

XVhcrtt n Btauda foi iv non-vodud, fl-ml u (ov a v«\hi\l HubU'st, the s\ihs.oiipts 

denoting diffcvont gubtests, tnkou foi all the combiuationg possible 


Tetrads of Type —Spcoificality in the "ciosa” conclations 
(7'yn) Will bo shown lu these tctiads, and it is important to consider this 
type before the ^-typc, because tlio “cross” conclations enter critically 
into a;-typc tetiads The 84- tetrads of type 2 i iiavo the following value 


Menn . 0 0241 

Obapivod Higma (X 0 0745) 0 0104 

Oi, ohsoivcd po (mean X O.BdS) 0 0204 

Tlicorotical Pli apiu'QMmatoly 0 0105 


We have mentioned that ?va may entail Bpeoihcahly, and the elimina¬ 
tion of tetrads involving JVa leaves 76 tctiads, with mean 0.0226, 
i.e,, observed pe 0.0191 (conventional). The tctiads thus entail 
erior 0.016 in excess of sampling orioi. 

To explain this excess wo nnay try out the vauous possible disturbeis 
of tetrads considered in pievious papeis That is, can ago correla¬ 
tions, “speed preference,” "similarity of relations,” group testing 
effects, calculation, mistakes and the like, account fov the residual, 
excess, eiioi, cither separately or as a whole? 

Ehininating all zx tetrads that might be disturbed by “speed” and 
“similaiity of relations, ” leaves 24 tetrads with moan 0 0173, that is, 
obseivcd pe 0 0140, the theoretical value being approximately 0 0105, 
and parlialling out Iho C-nioasurc (the effect of school and chiss^) 
this mean is lediiced to 0 0157, that j.s, an observed pc 0 0133 The 
excess error is now only 0.008, and iL might bo accommodated by age, 
and calculational mistakes, using the proper sigma, instead of the 
conventional value (mean X 0.8453), also slightly reduces this 0 008 



Tebad-differences for Vethal Svhtests 


337 


value Thus, elimination of one or two possible dislurbances would 
result m tho Si tetrads showing aamplmg enor only 

Tetrads of Type aj—Thoie aa-e 420 tetrad-diffeiences of this type, 
with value as follows* 

Mean of 420 tcfciad-cliffcipnces 0 0263 

Observed pe (mean X Q 8458) 0 0214 

Thcoiotical PB appioxjinatoly . g 0106 

There is excess error of amount about 0.018 in the above tetrads, a 
value similar to that observed for the verbal subtests. “ It is obvious 
that any specificality piesent in the verbal siibtests will be potent also 
in these tetiads. 

To explain this excess error we may try out all the possible dis¬ 
turbers of tetrads known to us: But the result is the same ns that 
obtained for tho veibal subtest intereorrelntions, and we are left with 
excess oiror of amount about 0015 (see that can not receive an 
explanation except by way of assuming a summation of many slight 
errors of the kind put forward for the Zi tetrads 

Teimds of Type y —The 126 tetrad-differences of this typo have 
value. 

Mean of 120 tetrad-diffoicncca , , 0 0171 

Obeemd po (mean X 0 845) . , 0 0144 

Theoictical PE appioximatcly , 0 0105 

Omitting the tetrads which involve Jva brings this moan down to 
0.0164, t.e , obscived pe 0 0138 Tho excess crroi, like that for the 
Si tetiads, can bo accommodated by age, C-measure, and “speed” 
effect Even befoze making allowance for these two or three influences, 
the excess crroi is only 0 009. The y-type totrads may thus be taken 
to fit the tetrad theory. 

At the present junctuie we sliould ask whether an explanation 
of the excess eiror obscived in the vaiious tetrads, in terms of a summa¬ 
tion of a few slight enors duo to effects such as age, calculation mis¬ 
takes, etc., is reasonable and likely to have a factual basis. On the 
one hand the non-verbal subtest inlercoriclations show no excess error 
in their totrads ' But the vaiious suggested disturbers of tetrads 
mentioned above (and in piovioua papoia) are authenticated m other 
work. The influence of distuibera such as “speed” (foi subtests 
6, 7), “propinquity” (especially for JtOj and idiosyncrasies (for 
subtests 2 and 5, relative to all others), can be observed by using the 
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verbal Bubteats 4, 0, 0, ami 8, Logcthci with the iion-vcrbal subtesta: 
It IS thou fouiitl iiial (on elnninatinpr tetrads involving r^o) a noticeable 
diminution is olisoivcd in tetrads which, apiiaYGutly, arc not disturbed 
by influencos of "speed," "propinquity,” and "idiosyncrasies.” But 
It would leiiuiio D errors, each of magnitude 0 005 (the amount usually 
found for tJio influcnco of age correlation), to cover an observed excesa 
evror of 0 015 (V"9 K 0 005^ = 0.015). At^umiug an excess observed 
error of 0.005 per influence, for each of age, Bchool and class, "speed,” 
"jiropinquity, ” “idiosynciaaics,” group testing, ‘'similar lelatious,” 
and calculation mistakes, a total excess error of amount 0.015 would 
result. The aasuinptioiq howevci, la perhaps nt moat only on the 
boi’dci'-lino of aoccptabiUty. Thus it w pobsiblc that the 0.015 excesa 
error observed in tho ease of the verbal subtesi iniercorrclations,^ and 
for tho zi typo Ictiads, can not bo reasonably nccepted as due to a 
siunnmtion of nuineroua small criois of the kind biought forward, 
while, on the whole, the excess error shown by the Z\ and y tetrads 
(less than 0 010 in each ense) is pos&ibly rcasonalily acceptable. 

Telrads of Type —This is the last type of Icirads to bo examined. 
The total 252 .^-typo toliad-difTcionces have tho following value: 

Meniv of 252 lettnd-diffDrDncea 0 0703 

Obseivcdpo (menu X 0.845) .. 0 0505 

TheoToticaV appioMitiately 0 0105 

Of the 990 totiad-diffoi'onccsforTablcI, (t) all the largest arc of Mype, 
and all but thice of the a-Lype nre of positive sign when the tetrads 
are in the form given at (x) above. (Of course, unless, otherwise 
stated, no regard is taken of the sign of tctrad-chlferonces, because for 
each positive difference there is air equal negative diffoience ) 

If wc omit tetrads involving 234 x-type tctiads remain, with 
mean 0.0720, No matter what effects wo try to make allowances for 
we always encouiiLer excess erroi of amount about 0 059 If we allow 
0,015 excess error, attributable to a sum of disturbances of the land 
accepted previously for other tetrads, there still romnms excess eiror of 
amount 0 057 ui the x-type tetrads for which wc have as yet no 
explanation. 

Tho contiibulions of tho rp* coircluLions to tho t-tcirads are given 
in summary form by tetrads of tho following typo, wheic I'w Is the 
GoiTolation concerned, taken with all the available non-veibal siibtests, 
two at a tunc: 
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There aie 12 tetrads of this type for each r«„, and means of these 
sets of 12 are given in Table II. The mean for the 12 wj-letrada for 
Tu 18 0.0992, for > 24 is 0 0910, etc. No single correlation among the 
verbal subteafcs gives a small difference m these w-totrads. The excess 
error seems to cover all the vcibal subtest correlations lelative to 
the non-verbal. 


Table II—Means tor 12 Tctrad-oippbrencbs (umiype), ron Table I 



2 

a 

4 

5 


n 

8 

2 


0992 

0910 

^^9 

0730 

0778 

0848 

3 



0540 


0623 

0601 

0574 

4 





0427 

0558 

0020 

fi 




mu 

0741 

0786 

0617 

0 






0591 

0476 

7 







0699 

8 




■i 





CONSIDERA.TION OP THE X-TVPE EiIROU 

It IS obvious that neither age, calculation mistakes, nor propinquity 
effects can account for the icsidual error shown by the a^-tetrads 
Any general effects due to author^s idiosyncrasies can not be taken to 
be potent, because x-tetrads for iss, '>u, ne, nr and ? 2 b, and the corre¬ 
sponding conelations for siibtest 5, should be free from residual error 
if idiosyncrasies were effective, since subtests 2 and 5 aio Thorndike 
subtests, while the rest are of the aiitlioi’s construction. 

Group testing anomalies can not be taken readily to explain the 
residual enoi The effect is not noticed in the tetrads of any other 
type of tetrads It is true, though, that any effect characteristic of 
verbal subtests only (or non-verbal subtests only) would be observable 
under the cutical conditions picsented by the x-tetrads The x-typo 
error, however, has been observed picviously under conditions free 
from group testing anomalies,® and, further, a test of the influence, 
made by calculating sepaiate r’s for each of eleven testing groups, gave 
results paralleled by the C-measure conelations (given later in this 
article), VIZ f that the x-typo error remained when the influence was 
taken into account. 

If “speed preference’^ enters the various subtests it does so m no 
obvious way. On introspective grounds, fiom the consideration of 
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errors made in the test-units, and fiom the general experience with 
BubtcBte, we must submit that subteats 2,4, 5,6, and 8, afford a battery 
giving good powor-speed measure, and tlmt the tetrads involving these 
Bubtesta are free from gross “speed proCcicnce” so far as these subtests 
me concerned. Of the non-verbal sublcsls, I, III, and lY, nie like¬ 
wise good power-speed tests, calling for the best tluvt a child can give 
under conditions free fiom hurried, slighted, woik. The a:-tetrads 
for these subtests show residual ciroi that cannot bo clifferontiated from 
that for any of the other aublcsts. If a misbahinco of the quantity- 
quality function is cutical in our subtests, then it would have been 
found in previous w'ork and, certainly, the whole question of the 
function would loquirc ic-cxpciimenlaUon from the foundations 
upWMcl. 

\Vg are loft, now, to eon&idor the effect of “school and class” which, 
we say, may icaemblo the effects that might be attributed to group 
testing nnomalies, 

The EJfecl of C-measwe.—'rhc C-incasiuo® is a scoio given to each 
gill, tlio same for each girl in a paiticular cla.ss, on account of school 
“standing'’ and clas.s position. It is objective to the extent that its 
foundation is the oKlcr SlnndardR lY to Vllb. It should serve, to 
some extent, as a measure of scholastic influences, such as reading 
aliihiy. 

The correlations of C-mcasiuc with verbal subtests have been 
given previously ® The following now coirclations arc recinived 
^Cii) J'c.v, rc.viii having values 0.3912, 0.3075, 0.3647, 0 2858, 
respectively With the coirelations now available we can calculate 
pmtial corielations for Tabic I, for C-mcasuic paitialled out The 
resulting partial mtoi corielations show that the non-verbal subtests 
have average mtcrcoriclation 0.2973, the “cro-ss” corielations have 
average 0.2700, and the veibal subtests have average intercorrelation 
0 4503. It is obvious that the tetrads for such a table will agree, type 
for typo, with those for Table I. The results for the Hz, and y 
tetrads, for the n-totrads (non-verbal subtests among themselves) and 
r-tetrads (verbal subtests among themselves), are similar to those 
given above for Table I, except that Blightly less residual crroi is 
observed throughout. The 252 a-lypo tetrads have value as follows 

Mean, 252 ^^typo tetiade, Table I, with C-mea'Svuc pai'tiallcd 
, out . , . . . , ,0 0040 

Observed po (mean X 0 845) , . 0 0641 

Thcorcticnl PE approximately . , 0 0105 
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Omitting tetrads involving jv, (analogy subtests) leaves 234 
tetrad-differences, -with mean 0 0660: Omitting those for rae and rsa 
in addition, leaves 213 tetrads, mean 0 0844, 

If we now allow, for these O-mcasuie paitialled correlations of 
Table I, the 0 015 excess eiior which might be attiibuted to a sum of 
eriors due to “speed,” “propinquity” (especiallyfor tts), and “idiosyn¬ 
crasies,” age, calculation mistakes, and the hke, we have still error of 
about 0.0512 for the T-iype tetrads, m excess of sampling error 
The grossest of these diatuibances (due to “speed pieference” in 
siibtests 3, 6, and 7, to “propinquity” for r 78 , and to “idiosynciasics,” 
for 2 and 5, relative to the other verbal subtests) should be absent 
from a-type tetrads for the four verbal subtests 4, 5, 6, and 8 (if ?‘66 
IS duly accounted for) The a;«type tetrads for these four subtests 
with the four non-veibal subtesta, for C-measure parbialled out, omit¬ 
ting the tetrads involving rea, aic 54 in number, with mean 0 0511— 
roughly the same as that above for the G-measuie partialled table 
as a whole, allowing 0.015 excess erroi 

Thus, with what may be desciibed as the rehneinents entailed 
by the C-mcasuic partials, and allowing for excess enor 0 015 as the 
sum of that due to various specified disturbances, the a:-type tetrads 
nevertheless show eiroi 0 050 in excess of that attributable to sampling 
and the specified influences 

A SiscoND Intbbcohublation Table 

We have used m Table I only part of the correlafcional data avail¬ 
able, and it should be determined whethei other intercoirelation tables 
give lesults in agieement with those already found in Table I In 
Table III we have included six non-verbal subtests and four veibal 
subtesls’ The “cioss” conelations for the subtests II and IV alone 
are new. 

Theie aie 630 tetrad-diffcicnces foi Tabic IV, with the following 
value. 

Mean of 030 totrnd-cljlTpienecs 0 0294 

ObsQi voci po (mean X 0 845) .. 0 0248 

Tbcoiotical PE fti^pioximatoly . 0 0100 

Theie is obseived, once moie, appreciable error in excess of that 
attributable to sampling. We now consider the tetrads in the 2 i, 
S2, y, and x types. 
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TAlMiK in ~rnO!)\'CT*MOMBWT CoURKTimONfl, N = 1037 GlllLS 
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There are 240 totrada of typo foi Table III, wiLli mean of amount 
0 0222; allowing for ?vc and r,j,vin (the formci because both Y and 6 
are Analogy subtests, the latter because of the speciheahty shown in 
tiro first paper’’) leaves 100 tetrads, with observed pe (oonvenUonal, 
t.e., moan X 0.8453) of amount 0 0130. Excess error of amount 
0 0095 is therefore entailed. 

There are 72 tetrads of type 2 j, ■with mean 0.0182. Eliminating 
Tvfl leaves 66 tetrads, with observed pe of value 0.0142, i.e., an excess 
error of 0.0100 

Some of the y-type tetrads for Tabic III have been included alieady 
in the results for Table I, but the 54 now ioirads of this type have 
mean 0 0144, or an observed pc of amount 0.0122, for the theoiotical 
PE of amount 0.0100. The excess error is now only 0 007. 

Time, excess erroi of about 0.0100 is found for the Zi^ zz, and y 
tetiads. It IS obvious that age correlations will reduce this excess, 
and a sum of slight errors attiibutablc to “school nnd class,” calcula- 
tional mistakes, and the like, might possibly explain the excess cnor 
shown by these tctiads. So fai the data confirms that found for 
Table L 

Theie aio 108 new a:-type tetrads for Table III, with mean 0 0520, 
Eliminating tetrads involving lyo and leaves 00 tetiads, with 

mean 0,0480. These a-typo tetiads thus show excess ob&civcd error 
of amount 0.0340. It is found that approxiiriaicly tins amount of 
error is associated with each foi Table III The lo-type tetrads for 
Table III, for Mo, Ms, Mo, r^, iob, lospcciivoly, have mean 0 0505, 
0 0554, 0 0516, 0 0448, 0 0615, and 0.0484. Thus no single Uu is 
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associated with small ii-type tetrad-diffciences The results axo 
again similar to those obtained for Table I The most significant 
tetrads arc those of a:-typo. But when subtests II and IV aie included 
in the table of conelations, as in Table III, the various errors concerned 
are less than those met with for Tabic I, a fact that should leceive 
consideration for a few moments. 

The aub testa II and IV coiinlate with C-measuve more highly 
than the other non-verbal subtests, and are like the vcibal subfcests 
in that lespect This may be taken to account for some of the deciease 
in excess erroi shown by the 90 r-type tetiads, when compared with the 
213 ^-type tetrads for Table I. It is a matter of some interest to pay 
regard to aubtests III and V, comparing them with subtests II and IV. 
On the ono hand, it may bo suggested, the subteats 11 and IV me not 
so “novel’' as aubtests HI and V (or as I and VIII as well); they 
are not so hkoly to be so dependent upon fore-practice, not-clear- 
understanding of the tost rcquiiements, conafcive inhibitions, and the 
like It might be consulted that effects of this kind have entered 
significantly into the a-type tetrads for Table I, so explaining the 
diffeience in amount of excess crioi observed for these tetrads in 
Tables I and III On the other hand, subtests II and IV can not be 
said to be of much intrinsic woUh os instruments m which eduction 
is critical: "Wo would place more value on subtests III and V, which 
are perhaps the best of the non-verbal m point of eduction mechanism. 
Wc took some pnms, m our first paper,^ to show that im.v could not 
be taken to entail speclficality lelative to the lest of the non-verbal 
subtests, and the excess observed erroi for the :r-typc tetrads for 
^xiiiV IS approximately 0.090. Thus, against a possible mfluonc© such 
as' ‘ novelty ” (including Ihercm influences like not-olear-understandmg 
of the test directions oi requirements etc) we can but place the knowl¬ 
edge that subtests III and Y involve eductive mechanism to an extent 
that can not be vouchsafed for subtests such ns II and IV. "We aie 
not disposed to accept the view that “novelty” and the like can be 
taken to account for the gi’eator excess erroi obseived m the a,-type 
tetrads foi Table I, chiefly because influences that might be anticipated 
to be as effectual as “novelty" (such as, say, ago effect) do not show 
excess enor so large as this under consideration, namely an amount 
0 036, given by Vo 050- — 0 034’*, wheie 0,050 is the obseived excess 
error in the .^-typc tetrads for Table I, and 0 034 is that for Table 
III However, theio is lOom for further work in which the matter of 
“novelty," fore-piacticc, etc, can receive critical attention The 
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maltci, indeodj is to loccive attontion m sonic work that wc have 
begun with a 500 population. 

Finally, to continue the consideration of Table III, wo must cou- 
olude that the .-c-type tetiada show excess error that can not receive 
adequate explanation in terms of the many influences brought forward 
by us in the couise of this and previous papeis The data for Table 
III IS similar to that obtained foi Table I 

Thus, after Inking account of many Hourccs of orior known to us, 
including scale anomaUcs, the cftccts of school and class, calculation 
mistakes, age effects, “speed preference,” group testing anomalies, 
etc, we are left with a not inconsiderable obscived excess error in 
x-type tetrads For all the TJ-type tetrads that eau bo constructed for 
our verbal and non-verbal sublcsts this excess cnor is not less than 
0.050 111 amount, after making allowance for sampling and for an 
amount 0.015 attiibutablc to influences such ns age, etc. 


The PnoLi/EM op a VicnnAn Giioui> Factou 

A gioup factor may be shown for the vcilial aulitcst intcrcouela- 
tioiis when ( 7 „ (the common factor obseiwcd m the non-verbal sub¬ 
tests*) is paitialled out. Using Iho non-verbal subLests ns “refcience 
values,” 111 terms of which the (/-sniuraliona of the voibal subtests 
may be determined,^ wc calculate the specific conclaiions'^ for the verba! 
subtests among themselves: The 1*080118 arc given in 'J’nblc IV. The 
Table is for Gn parlialled out. We have lo decide whoLhci these speci¬ 
fic corrclatioiiB fit tho tetrad criterion, so that a group factor may be 
taken to run tluough them. 


TADliB IV—PaUTUL CoB«T5I,ATIOMS, for (in PAHTIAI.I.En OuT, DuRIVEl) FIIOM 
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There aio 105 tctrad-dififerences for Table IV, with the following 
value' 


Moan of 105 tetiad-diffeicncps , . , 0 0196 

Observed po (mean X 0,846) . q oi 65 

Theoretical PE approximately , 0 OlOO 

If we eliminnLe totrads which involve rss and rse (which, we have reason 
to suspect, involve specifioahty due to similarity of lelations), the 
above mean is leduced to 0 0166, i e , theie is observed pe of amount 
0 0139, for a theoietical PE 0 0100 It is obvious that by partialling 
out age corielation and C-measure this observed pe will become nearly 
exactly the same as the theoretical value We conclude that the Two 
Factor Theory fits the specific conelations The new factor, which 
appears to be common to our veibal subtests, may be named V. 

We have amved at the oonolusion, then, that the verbal subtests 
involve two common factois, (?„, which we would take to be the uni- 
veisal ( 7 -factoi, and V This may explain the apparently intiactable 
losiduum of obsoTvod enor in the tetrads for the verbal subtest inter- 
oorrelationa (comparing the results found in. oui fust paper'* with 
those foi tho second paper,® for the non-veibal and verbal subtests 
lespcotivoly), and in the totiads for, as was suggested earlier in this 
paper," thee excss erior tlioro scorned to be on the border-line of accept¬ 
ability in terms of extraneous influences of the kind “school and class, ” 
age, etc Now the iolmd effect of two common factors becomes 
scarcely chsLinguisliablo from that of only one common factor when 
the correlations are of nearly equal magnitude, and it will be noted 
that the voibal aubtost inteiconelations aic of such, a neaily equal 
magnitude Thus, if wc accept the (7„ factor found for the non¬ 
verbal subtests, and the V factoi found in addition for the ver¬ 
bal aubtest mteiconelations, then, the lesults obtained for the tetrads 
of the verbal subtest intercoirelations fit well with tho theoretical 
expectations. 

We have now to turn to oonsidev explanations of the V common 
factor, of the observed excess error m the a-type tetrads 

If the various effects and conclusions considered in the course of 
our papers ai© acceptable, wo have inductively naiiowed the field 
of possible explanations for the T-factor. We are left, indeed, with a 


Under Tetrads of Type Y 



346 The Journal oj liducational I^sychology 

possible explanation in Iprins of “vcrbality ” It is tnio, however 
that doubts remain, especially conceimng the influence of ‘'speed," 
"novelty" and forc-piaoticc, and coujilivc dilfcroncoa in the verbal and 
non-verbal subtests.-’^ JTowever, our data are nob pub forward aa 
a finished pioduct, but as puniarily an c\cvciso in correhitiona, iotiads, 
and errors otlicr than sampling Tlio verbal and non-verbal subtests 
used in our work, while being siinilar to those generally used lu "intclli- 
gonce" tests, aio not complololy KUited to work tliiib would make 
contact with matters of Bcicnliilc psychology: Wo can now employ 
teats -which entail cductivo pvmciplcs more thoroughly, we can con¬ 
struct bcttei non-verbal subLcsls on piimarily percoptual lines. We 
have under way a ic-evperimcntation with a fiOO population, -which, it 
is hoped, will go far to place us coirectly ou the path of facts of some 
psychological value It is with knowledge of the limitations^ and the 
need for further work, that wo turn to considci our Y-factor nr terms 
of "veihality." 

Wo should ask, in the fust place, how wide the V-fnoiov might 
bo expected to extend. I.s it likely that it will extend tlnough all 
verbal subtests whatsoever, so constituting a veibal gene}al factor? 
Or is it likely to be confined to the coUccUon of verbal subtests used in 
our experiment, so constituting a limited factor? 

Wo have observed disturbances in n-typc tetrads previorigly,^ 
for other veibal and non-verbal siibtcsls. But it is moie important 
to recall that work by Davoy,* iilthoiigh obtaining icsults that cor¬ 
respond apparently closely with ours, yet found that results for two 
verbal subtests did not conospond with the moic usual result, indicat¬ 
ing instead the absence of any verbal geneial factor or fnctois Tlius, 
Dfivoy took the view that the spcclficality f^hown by verbal subtests 
must be of limited lange Further, the spocificality obsoivcd for some 
of her verbal subtosts was atlributcd to “similarity of relations " 

Oonsideraiioii of Davey's Data and Conclusion —Davey’s work was 
with veibal subtests, orally applied, and pictorial siibtests Now 
pictorial sublests arc at best only secondarily pcicopLual Woicls and 
sentences arc used in the test diiections of all our subtestfe, but once the 
puiposo of the subtest is "rgI," a difCcicucc between our voibal and 
non-verbal subtests is that words ai’C not ostensibly used, even iinphc- 


* Olio poasiblo niflucncso, so fat not monlioncd, ia that of au oftect duo to tlio 
siibtcbta being applied a day apart Previous work, howcvei, shows that Buch rni 
mfiuciicc must bo slight, at most 0 005 eiior icsuUmg m aj-typo tetiads 
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itly, in the non-veibal subtests (excepting, say, subtest IV). This 
condition, however, might not have held in Davoy’s pictorial subtests. 
Again, some of Bavey's pictorial subtests had words oi sentences 
diiectly involved (pictures had to be selected to match short para¬ 
graphs with words omitted, names of items in pietuics had to be 
written down, etc , these verbal parts being orally applied) Thus, 
there is a possibility that woid-ontailment, with possible “repioduo- 
tion” individual diffeiencos,*^ is not subjected to sufficiently critical 
oxpeiiment m the pictoiial subtests. Some of our non-verbal sub- 
tests aie more primarily peiceptuol than pictoiial subtests can be. 

Wo have some evidence that the oral subtests used by Davey entail 
specificality relative to othei verbal subtests,® and some of the spocif- 
icality observed by Davey might be attributable to an influence of the 
oral presentation The oral Analogies, Opposites, and Classification 
subtests entail specificality which Davey attributed to “smnlai'ity of 
relations, and our work offers some support for such a specificality in 
these subtests. But the F-factor in our woik is observed over and 
above thia latter specificality, and likewise over and above any factor 
attributable to picsentation of the test material It seems that the 
F-faotor is over and above any specificality found by Davey, a matter 
that would follow upon acceptance of the arguments put forward in the 
previous, and following, paragiaph. 

Again, the oral Inferences and Likelihood subtesta, which alone of 
Davey’s subtests did not show excess error in the a:-type tetrads, and 
upon which the conclusion concerning a UniUed factor depends, cor¬ 
related only 0 35 (approximately). Under the conditions most verbal 
subtests correlate more highly. The test-units in these two subtests 
are somewhat lengthy and complex in stiucture, especially perhaps for 
eight to ten yeai olds of Davoy’s eight to fourteen yeai group. It is 
possible that not-cleai-undci*standing of the test lequiiements, oi 
excessive memorization effect,® or lack of ability of keep the whole 
test-unit before the "mind’s eye,” have entered cutically into these 
two subtests, resulting m a smaller coi*relalion than might he expected 
in the cii’Gum.stances 

Thus, the facts are perhaps not too strongly in suppoit of the con¬ 
clusion concGining a hmited veibal factor, and nothing hitheito found 
m this field can be taken to contiadict the facts found in oui work 

After eliminating distuibanccs due to vaiious possible influences, 
our work indicates with some certainty that specificality iiins thiough 
our verbal subtests, and amounts to a single factor that we have 
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named V The spociricality would appear to bo Iho moio discernible 
the moic the non-verbal aublcsU lend towards being primarily per¬ 
ceptual. Further experimentation is icquired before wc can decide 
that the F-fnetor i.s very extensive, hut our work may bo taken to 
lend to indicate that the F-factor would possibly oxtend through most 
verbal siibtcsts in current testa of “intelligence. “ If oiu consideration 
of Davey’s conclusion hn.-? any fncLiml basis, then wn may Gonclude that 
no work extant contiadicts the posaibllity of llicir boiup; F~speciftcality, 
appro.ximtitoly a single F-factor, of very wide uingo 

The possible couUct of Una F-speciGctiUly with “vepioduction" 
Jins been touched upon in the picvious paper/ and we would suggest 
that the facts of the general law of rolonliviiy of dispositions/ intro¬ 
spection, knowledge that wo have of individual differences m the cate- 
goiics specified/ and the facts of aphasia, all tend to support a view 
that F-spccificality might be expected as the consGciueiico of individual 
diffoi'cncos that we liiive covered by the Lena “icproduction" ^,e., 
loproduction of words, phrases, sentence.^, oi ideas The theory, in 
any case, seems worthy of further expcrimmlnl attention. It is not 
improbable that “ropiodiiction” conslitiilcs an influence in the “speed 
preference” effect in verbal subtcsls. 

For the preaoni, tlieii, we Avould say that it i.s po.ssiblo that when 
repioductlvo influences are allowed scope in subtoflis, then F-specif- 
icality would tend lo show. Similarly, no doubt, vocabulaiy can 
augment the F-specifioahty; although our data give no indication that 
the F-spccifioality is conditioned by an aniiUicsis that was employed in 
the verbal subtests. (Subtesls 3,6, 7 and 8 were constructed of words 
with simple concrete moaninp;, while 2, 4, and h contained words of 
more abstract meaning) 

Tn point of fact wc obtain F-faclor cxlonding through all our verbal 
subtests, tending lo indicate a general F-faetoi in addition lo the uni¬ 
versal (/-factor in verbal subtesta We have mentioned pieviously, 
however, that the conclusion is tentative There is loom for improve¬ 
ment in the matter of the facts, and ivc await with inLoiost the results of 
our second experiment with other verbal and non-verbal subtests 

CoNl3Ii\J8ION» 

We have covered a mass of corrolational data in the courae of two 
papers and tho picscnt one, dealing with subteats apiilied to al037 
population of girls No doubt brevity has left marks of ambiguity or 
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of unintelligibility, foi wo have had to give conclusions frequently 
without much refeienco to the relevant data. There aie likely to be 
found eiToi's of calculation or transcription But any leworking of the 
correlational data would, we submit, give us no cause to depart from 
the following general conclusions. 

1. The non-vcibal and vcibal subteats have a high coiielntion, amounting to 
0 82 foi a summed correlation for many siibtosts of both kinds The fact stands 
m opposition to the opinions that liavo sometimea depicted the two abilities ns 
mdependent 

2 Ill the case of the non-veibal subtests, tlio tctiad-differonces matched with 
some exactnesa the value to be expected from sampling error * This held good 
regardless of the size of the sample, foi sub-populations of 100, 200, 500, up to 
the full 1037. 

3. In the case of tho voibal subtesta® the tetmd-diffeiencos weie appreciably 
larger than those to bo expected fiom sampling alone After making allowenoea 
for evident disturbances thoio remained excess oiioi of amount nppioximatoly 
0015, ft value soaioely to bo accepted as mcioly due to disUubancos ol the kind 
considered in explanation of it 

4 But much highoi losidual error oamo fiom tho tetrads involving both veibal 
and non-voibal subtost uonclntions This was of magnitude about 0 060, thus 
indicating with ooitamty some factor or faotois m one ov both of tho two kinds of 
Bubtosts 

6 On. olosor examination tho ovidonoe was against any gioup factor in tho 
non-veibal sublcsta, but ^vns in favor of one gioup factor extending rather evenly 
throughout the voibal siibtcsls tiuoii a factoi, moreover, would explain the 
roughness of tho 5t of the totiad rormiila to tho voibal subtoat interuoiielntions, as 
mentioned at (3) aliendy given 

Q On tho whole, tho indications arc that this ^-Cactov extends thiougli all 
veibnl abilities, and theiofoio may be called a genoial factor V (as contiaated with 
the univeisal genoial faetoi g which is found m both vevbnl and noii-voibal subtests 
alike) On this matter, howcvci, thcic n.ro icc|iiuccl fuithei facts These are to 
leceive consideiation in a subsequent expciiment 


In conclusion, we would offei, onco moie, our very sincere thanks 
to Trofcssoi Spearman for willing guidance, for many aids to a cleaier 
view of facts considered, and for many kindnesses given thioughout 
oui woik m his Laborntoiy It has been a true pleasure to have been 
a student and lloscaroh Assistant under Piofcssoi Spearman. 
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ORGANISMIC PSYCHOLOGY AND EDUCATIONAL 

THEORY^ 

KENNETH SELTSAM 
Ilmvcisity of Mmiiesotfl 

There has, within the last live years, come into piommcnce a 
so-called new school of psychology known in its original setting as 
“Gestalt-theoiie,” as “Configuiational'’ in the translation of Titch- 
ener,* and still more lecently in the language of Wheeler, ns “Organ- 
ismic."^ Very few people arc awaie of the fact that in point of origin, 
at least, it is almost contompoiancous with ‘'behaviorism/' that if 
anything, it is older of the twoJ Whatever may be the opposed 
contention of systematic authorities, the membeis of the school 
consider it to have begun with a study of “apparont-movement^’ 
made by Wcrtheimci lu a Gciman laboratoiy some time in 1912 
Its longer suivival than that of behaviorism, it is said by some, may 
bo attributed to the fact of its iclative slow growth However that 
may be, the organismic thought is demanding serious considoiation 
from psychologists in general It is forcing the perhaps too long 
unquestioned orthodox psychology to make a moie careful invoice of 
stock And m that probing process, if we may so name it, educational 
theory has not been, and cannot be, immune 

The Main Contentions op OIlGANIS^^c Psychology 

Before considering organismic, oi gestalt psychology, as it is related 
to educational theory, it would perhaps be advantageous to inquire 
into the school's mam contentions Roughly they may be classed 
under two heads: Those relative to the circumstances involved in 
any event, and secondly, those peitaming primarily to the individual 
experiencer, To the first of these, would be given the name situation- 
as-a-whole. A lesponse, the organismio psychologists say, is never 


^ The Editoi announces with regret tlic death of Kenneth Seltanm on Nov¬ 
ember 30, 1930 This pnpei was picpmcd by Mi. Soltsam while at the Univeisity 
of Kansas 

*Hel8on, H American Joxirnal of Psycholody, Vol XXXVl, pp 343, 49B,Vol, 
XXXVII, pp 25, 180, 

® Wheeler, R II “Tho Science of Psychology " 

^ Boring, E G “History of Expeiimontol Psychology ” 
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made to an isolated stimulus. Tlie S —> R dcscuplion of events ^vluch 
13 presupposed by the theoviDS of aHSOciation, attention, anti bcliavior- 
131T1 18 obviously not true to the facts of the case. A response (to 
State the law of confiKuraUon) la made to a aitiiiitian-fts-a-wholG, 
and if bo any paiticular delnil, always to that detail in its lelation 
to the other details. The oiganisiiiio position maintanis also that the 
psychological siliuitiou is not dilToronC fiom the chemical or the 
physical in its genoi'iil aspects, and is, tlioreforc, governed by similar 
natural laws. 

One of the natural laws winch m seen to have eonsidorable psy¬ 
chological aigiuficancG is the Law of Leasl Energy, whose statement 
for application to the field of psychology la not essentially different 
from that for other sciences. If movemout of energy la always in 
the dircotion of a low potential, one iiniuodiiUcly comes to rcalizB 
that such concepts ua “Trial and Enoi" aio at best absurd It is, 
according to this iniimcr of facing the problem, absolutely impossible 
for an oiganiftin to net without accomplishing Hoincthing with logard to 
the point of low fiticss, which oiganminiciilly is (lorniod in any leaining 
situation as the “goal.” In general, the Hitualion-as-a-wholc is seen 
to be an enormously complex thing. As such, it eainiot be rcpicsentcd 
by the tremendously “un-eoniplox” Kyinbol S, as that sign has his- 
loiically been used. 

As one inigliL expect, the organmmic psyehologiats have still moie 
lo any of the orgaumm-nB-a-wlvolc They iclicl violently against the 
atomistic physiology of the conditioned rcllcx school luul otheis, 
They maintain that structuial analysis can iinvor act ns an ond in 
itself; that lo assume that psychology is lo icach the ituiks of a science 
through the analyses of groat intiospcclioniHLs, ns the Titchenerinn 
formula reads, is an impossible nbsinnptioii. The oiganism-as-a- 
wholc IS to be appioaclicd as an integrated mill through the mediiun 
of funclionnl analysis. Expcrimcniatioii is to be conducted by 
alteration of the condiUona; and when Hus alteraUou lakes the foini 
of extreme hnrulation (ns in the case of neural study) it is to be recog¬ 
nized that the results are lo a coituin (‘xtont, at least, absLiactioiis 
from the real phenomena. Just as it is imposHiblo to think of a aitua- 
tion-as-n-wholo in terms of S, so it is, m the light of the oigiinismic 
position, iinpo-ssible to label the icnction of the oiganism-ns-a-wliole 
as R, simple rospoiiso. 

In gcnei al, the lUajoi contentions of the new .school may be summa¬ 
rized very crudely m what would seem for them a definition of the 
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science Psychology is a science of “wholes" which denis with the 
responses oE oi'ganisni-as-wholps to situalions-as-wholes Anything 
short of these, on the one hand is essentially physiology, and on the 
othei, physics 


The CiimcisMH op Gertam', on Organismic, Psyciioiogi 

The structuralistic psychologists, m the meantime, have not seen 
fit to accept these violent ciiticisms as such. One should not expect 
them to do so One of the typical Tcjomdeis, and one peihaps less 
logical than any other, is that the new school is, after ail, not new 
One finds such statements as the following frorti Boring “Like James, 
Dewey was a Oestall-psychologe twentj'’ years too soon"^ Squires 
in a recent comment demands that above all else in our dealings with 
the new school of thought, wc maintain a “balanced historical sense 
In a senii-popiilar discussion, involving about as much over-statement 
as might bo expected of such, Kobmson would have us believe that 
not only is tho piinciplc of configuration not new, but of questionable 
actual significance ^ 

The problem of tho age of any hue of thought is strikingly para¬ 
doxical Age is at once both desirable and undesirable Were 
IS not possible to tiace oiganismic thought back tluough the history 
of psychology—through Dewey, McDougall, James, the Mills, Stout, 
and even back to Empedocles in the third centuiy B C—oilhodox 
psychology might have gi*catci ground still for criticism That 
it has been a development, an cvolutionaiy outcome, rather than 
a scientific iipstait should, il would seem, be a favorable indication 
It IS, also, quite possible to loconeile the fact of age with the idea 
of a new contribution to make To assume otherwise is to admit that, 
since “there is nothing new under the sun,” it is futile to attempt 
originality, and that neithei sociological nor moie naiiowly scientific 
movements have any cs>sentu\l ovoluUonaiy value 


'Bouiig, JU O llibloiy of lixpeiinieiitnl Psychology Atnencan Journal 
of Psychology, Vol XLIT, Apr , 1030, iJ 510 

^Squups, P. C , Gcatftlt Psychology nnd the Gestalt Movement, A Cuticism 
of tlio Coiiliguuilioiiist's IntPipiptation of “Stiuctoralism’* Amencan Jownal 
0} Psychology, XLll, Jnn , 1030, p 134 

^Ilobmson, ESA Little Gcimaii Band. Novo Republic, November 27, 
1929, p 782 
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Siiico a Rioat dinil of the oiganisniic expoiiuiciilaLion has bccu 
conducted with lumnalH,* in a maniipi' somewhat strange to traditional 
method, it is siiul hy bonifi that the gosUilt appioacli is a return to 
ftiithvopomovpluBiu. Whtvl could Iw, however, \\\ the genuine sense oi 
tlie word iiioio so I liaii the lyiucal expcuiiiciil out of which has grown 
the concept “tiial and eiioi" iH indeed diiTicult to imagine. Any 
ovpprimenlaiion ^Yhlcll rcIh ns ila cnlrrion of succc.ss a pcrforinntico 
demanding of an animal at least aveiugc human intelligence is ultiU' 
anthropoinorpluc If, however, we aie to hold tliat an experiment 
which gives the animal an “oven cliance” is thus to bo desenbed, it is 
possible that aftei all lieiug anllu’opomoiphic is not the '‘crime'’ vt 
once was 

Again, wc arc told that gestalt, or orgainsmic, psychology is purely 
theoretical—the, mind-child, ho to speak of ovei-zealoua Teutons 
Since nothing has been proved (so the ciiCiei.sni iiiuh) very little con¬ 
cern need bo bad This again HccinH hardly fail Wein wc to assume 
such an absolute standard in our dettlmg-s with scientific facts and 
methods, piogicss would bo pennaneiiUy liiillcd. blxpcnmentatiou 
of any kind presupposes a certain luimbei of working hypotheses 
However one may use logic, it ih diflicult to imagine an c-iperimcntal 
situation not demanding a certain viewpoint of approach which, of 
neccasiiy, must remain in ihc thoowilical lonini. To bo sure, any 
working hypothesis doaerves to kIuiuI or fall in Leriiis of expciunentnl 
verilication. UntiUhatUme,liDWov(‘r, losivy that certain ahsmnptions 
iiro valuoloss simply bocaiiFiO they have not been tested is at best a 
misconception. 

Still again the gestalt conliibiiiions have been said to exist essen¬ 
tially in an. alteiatiou of conceptR Inaload of “trial and eiror," 
“apperception" or “libido” we have “in&iglit ” “Matuiation" 
has taken the jiluce of the "stampmg-m pioccss.” And soforth Itis 
triiG that the orgaiiismie psychologists might give the name “condiUoa- 
mg” or “learning by repetition” to coilnin aspoots of the learmnp; 
situation tlicy would desciibe. So, loo, one miglit call one’s office- 
chair “watci " In ihc sense that thcic arc certain fuiidamental 


^Kohlci, W. “Montfility ol ApOH", Wherln luid Pt'ihins C'oiifigumtioiail 
Lca\uing in the GoLdfwh CWjiardtnio Payc/iology Vol. VII, No 1 

March, 1,030; Ilclson, II,' Insight m tlio 'Wliilo lint Journal of Expenmenlal 

Psi/cJioIopy, Vol. X, 11)27, pp 378-300,1 ewift, M II hlrtiieiiLal veiais foiifg- 
uratioiml Ilesponsc m the Chick Joutnal of ExvmminUd Psydolagy, Vol XIU, 
No 1 
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finite constituents such a statement would be correct It would, 
nevertheless, not be true higtoncally And, after all, a concept lias 
value only insofar as there is not contradiction in its historical usage. 
Essentially, what lies behind such criticisms as those of Kuo, who would 
so to speak, “junk" all concepts, is a dissatisfaction with the tendency 
to so jumble ilioir meanings as to make them practically useless.’' 
A concept, strictly speaking, must suggest subtle differences and to do 
so it can not be so overloaded as to mean everything. As such, it is, 
prematurely, destined to mean nothing 

There have been still other ciiticisms.^ Generally speaking, 
each involves a certain validity It would bo foolish to contend that 
gestalt or organismic psychology is in any sense a perfect cieation, 
against which all criticism is misplaced As a school it is both old and 
new, theoretical, and perhaps over-ambitious So long, however, as it 
hns an amplification and a ficshness of appioaoh, no true scientist can 
well overlook its attempts 


Organismic Psygiiouogy as a Contribution to Edugationau 

PHILOSOtHY 

The discussion so far has dealt rather aummaiily with the contro¬ 
versial aspects of “Gcstalt-theorie” as a school of general psychology. 
It shall now be the attempt to analyze what seem to bo its contributions 
to educational theory. Such on analysis must, for the most pail, 
be based upon opinion and logic, since educational experimentation in 
the field is almost non-existent. 


^ Kuo, Z Y Psychological Rimewt Vol. XXIX, p 344 

2 Calkins, M W. Ciitieal Comments on the Gcstnit-theoiie Pbijchological 
keareui, Vol XXIII, 1926, pp 135-158 

Ilsmo, H n A Suggestive Hoview of Gesfcall Psycliolog}' Psychological 
nemeio, Vol XXXV, 1928, pp 135-141 

Pillsbuiy, W B. Gestalt vPiaus Concept as a Principle of Explnuntiou m 
Psychology Jownalof AhnoimalttndSoc%alPsyih6logy,'^o\ XXI,192G,pp 14-18 
Rignauo, E The Psychologicn.1 Theory of Poim Psychological Rmcio^ 
Vol Vlir, 1926, pp 118-135 

bund, P II Tho Phantasy of Gcslnlt Jo«rnaI o/Ge?jcr(il Psycfiolopy, July, 

1029 

Woodwoi til suggests that the S ~-*R desciiption bo changed to icad S —»org 
-* R The orgamamiats of comae mamtaintliat this dcaciiption is still e-rtromely 
atomistic. It IS ncvortholoss, something of a lecognition of the oigamsm-ns-a- 
YjllOlc, 
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In pcluciition, if any jjIhcp, il hIiouIcI be tlosii'jible to consider stimu¬ 
lating cucunihlanoes as wholes Wc may, perhaps, owo the develop¬ 
ment of the boliiivioiisHc conct'pl “Htimulus," m tlm extreme isolated 
sense, to such foiimdalion as Morgan’s law of piirHiinony jii science 
Forever, we have been atleinpling to “Htrip*’ e\perieuc(* to the limit. 
The lay tendency in this direclioii ih avoII sliown by a study of the 
belumoiislic roaclioiiH «1 ealllo made houk* lime ago by Stratton* 
In tins analysis, it becouieH appairnt that then* is no correlation 
between the presence of n rod Hag an<l anger in cattle The anger 
icaction iR aroused only when the total biUuilion is established—when 
the flag is waved in an annoying nianiicr, wlieii the waver jumps about, 
making peculiar vocal soumlfe and slirriiig into molioii the dust about 
him 

The language fi(*l(l agiun provides mi inlci esting source for examples 
of the inadequacy of the “simple slimulu.s'’ Iheoiy If I piesent the 
words “Blanche White WeiHs” lu a Crcp asaociation Lost, to a group 
of subjects including different ages and professions, the reactions arc 
certain to vary tremendously. To the naive, “Blanche AVlntc Weiss” 
IS not moie than a rather peculiar name To the person well trained 
m languages, it seems as tluee rcpclilious of llie same woid, “White 
White White.” Between these two exlroines and varying dn ecllywith 
knowledge of Frencli, German and lOnglisli, >vill be inloimediate 
reactions Yet, throughout, the physieul stirmiluH is exactly the 
same. 

Until the teacher comes lo appiccialc the fact that the stimulus 
winch ho presents exists only in lelation to Uie learning siLimtion-as-a- 
whole, the leactiona bo obsei voa will loprcscnl to gieutcr or less degree, 
a dilemma Only when he rcaliy.es that a woid of saicasm, i\ smile of 
contempt, or an unfair concession is bound in most cases to emerge 
from that whole «and doiinnute il, will he be aware of the inadequacy 
of independent emphasis upon some bit of subjoet-mattcr His 
ability to understand why eertam “Btimnh” fail to call forth certain 
“responses,” will vaiy dncctly with his coinpichcnaion of a tiemen- 
dously complex situation He is not, aftoi all, the first violinist in 
a metropolitan oYcheslva. lie is a whole oveln'si.ia \u himscK, and 
while one Bound, that of hie ono arm violin, may (loiiuimU’, it docs so 
only as an emergial pui t of a mtiiation-fts-a-whole 


* Stratton, G M.' The Coloi Hod and the Angoi of Cattle Ihychological 
Umew, Yol XXX, p 321, 
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Howcvei prone wg may be to express disapproval of what his¬ 
torically was "faculty’^ psycbology, we have contmned in a striking 
dogreo to do “faculty thinking.” We talk of "redexea” and of 
“automatic habits” We continue to debate the questions as to 
just what paits of our organizations are native and what acquiied. 
In our attempt to be scientific, wc have seen fit to study anatomy and 
physics as atomistic sciences, instead of the psychology of leainmg 
A child has been educated in history and geometiy, not in general 
undeistanding His biology teacher has refused to aid in the correc¬ 
tion of his English A preminm has been placed upon his accumulation 
of an abundance of rather meaningless data, even by methods admit¬ 
tedly unethical It seems we seldom stop to think that wc are 
educating a whole child, who exists as an intact organism and only as 
such 

We continue to define learning as “little more than the estabUshmg 
of bonds between lesponscs and stimuh,”^ apparently naive to the 
chscovcrics of such experiments as those of Haller m the eighteenth 
century,- and the masterly studies of Lashley in our own period ^ 
A stimulus has been considered to effect certain specific connections, 
not the whole oiganism With Gates, we have said, “When once a 
desired leaction is made, it may be stamped in by further exercise 
until well learned, so that later it occurs piomptly and surely”'* 
Learning, Ihiough experience as such, or drill, has been emphasized 
“At piesent the attitude of many tcacheis toward drill work is under¬ 
going a wholesome change We aie commg back to dnll. The neglect 
of necessary drill worlc has been one of the bases foi just ciiticism of 
the ‘soft pedagogy^ m the schools"^ All the while we have been 
speaking with confidence of somethmg of which, as Lashley tolls us, we 
know veiy little 

At the same time, the human organism has been made to act 
in a fashion foreign to any oihci natural phenomenon. Ho has been 
said to learn through a meaningless repetition of muscular movements 
Vaguely, the idea of goal-seeking, oi action towaid a point of low 
organismic tension, has been lecognizcd for a long time For Kil- 

^ Douglass, II II "ModGin MfUiods la High Scliool Teaching ” Pp 22 
2 Ilfillcr concluded that by the time a man died, ha would, according to the 
tiacG physiology, have to have 200,000 imptossions foi evciy gram of giey-mnttei 
^Livghloy, K “Binm Meohaniarns and Intelligence " 

^ Gatos, A I “Psychology for Students of Educntion ” Pp 212 
^Stonrizand, M J . “Progressive Methods of TeachingPp 227, 
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palnclc, it iH “iiimd-sot-to-un-end ” TTo alno suggests that before 
reaching that end tlio organism may, iii lh(‘ pioccHH of choosing certain 
means "l)t‘ tom wilhiii.’'* Almost nowhere, liowovin, is a cue given 
to an undeihliuuliug of the oiKaiusiu as n, ptut of a natural scheme, 
all of which, it is lallu*) logical to suppose, is govoriicd by compainble 
laws 

Wo Iwwo siiiiiihlcd luiic afloi (inio m our iiU<‘inpt lo explain why 
it IS that John Jones, who has pumtically iho sanu' nmnlal capacity 
(ns inciisurGd by coUum entena) us Ham Hinilli> dors not Jsoe fit to 
“apply'’ himsolf \Yk have said, “Ham hUrs to Biudy.” Never, 
apparonlly, luivr wo appiccialcd Ihoi’ougldy the fact that possibly 
there IS just na oven a baluiicc of lon.sion m onr ca.sr aa in ilie other 
For Sam Smilh, study iirovulcH the gicatcst icsolulion of a most 
complex ayslrin of strcssp.s, internal and olhriwisr John Jones, 
on the other hand, organized differojitly II(* had difTorent goals, a 
different configuration of sliesscB, and conHequcntly la a different 
whole. Both iiulividiials function according to iho same general 
’ principle —01 ganisniically, llio law of luast cnoigy. The thought here 
IS not new. In ovoiy laugungc tlipix* are pioviulis oxjncssing in a 
crude way the idea involved. But as a point of scientific emphasis in 
psychology, it ia relatively new and can, if correctly nppi eciated, lead 
to a groat clarification in chaiacler and pi’raoiiaUty study 

Finally, organisinic psychology forces educational philosophy 
to reconsider whether the liodonic pouceplion, which has abounded 
since Socrates and no doubt even before, is after all, the true con¬ 
ception Is “happinefis” a goal of intin’s activity, as such? Does 
“practice with satisfaction^’ explain selection foi continued usage? 
Do the very possibilities of attaining happiness fade immediately 
as that most abstract of all abstract tluuga is aimed toward? If 
education is to answer negatively with the gestalt or oiganismic 
psychologists to these questions, the whole view of education will be 
more oi less altcied. It will be broadened The organism to be 
odueated will be seen a-i an cmoiged part of a hu'ger whole winch m 
turn, stage by stage, may bo said to include the whole iinivcise The 
oiganismic psychologiHt’s “human” is a hu'gor being, tie is not an 
isolated phonoinonon dopeiuhng for his growth upon .some philo¬ 
sophically abstract principle lie moves for the same leason that a 
cuiTcnt of air moves. For him, experience is lieai'iiig, seeing, and 


^Itilpatnck, W H ; “Foundations of Method.” P]j 103 
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feeling all at once He does not see mthout hearing, nor does he hear 
without seeing He matures in the same way that any physical body 
changes He is a being '‘attuned to the world/' and undeistandable 
only ns such* 

In conclusion, it would scorn that we can believe with Boring thal‘ 

Tho piogioss of tlioiight is giadual, and the enunciation of a “new’' ouicial 
principle in science is novoi more than nn ovciit that follows naturally upon its 
antecedents and lends pic&cntly to unforeseen consequents.^ 

and still agico with Squiica*. 

Every system has had something of value to contiibutc to oin total fund of 
knowledge * 

If gcatalfc 01 oiganisiruc psychology has helped to claiify our 
picture of the human organism that we would educate, if it has stimu¬ 
lated inquny and application (and one has but to examine journals m 
speech Gducatioii,^ music/ and so forth^ to icalize the fact) certainly 
wo must recognize that the organismic school has a contribution to 
nmke to the theory and piactiec of education which can not well be 
Ignored. 


iBoi'iiig,E G TheGostaltPsychologymidtlicGestnUMovemeTit ilwencan 
Journal 0 ^ Psychology, Vol XLII, No 2, April, 1030, p 308 

* Squiics, P C. A Ciiticiein of the Configiiratioinsb’s Interpretation of “Stuic- 
turnhsm " Amencan Journal oj Psychology, Vol XLII, No 1, Jamiary, 1030 

»Giny, G W . Gestalt, Bchavioi and Speech Qaarterlj/ Joxwml oJ Spcecfi, 
Vol XIV, Nov , 1Q28, pp 530-534; GcBlalt Again Vol XV, Ecb , 1920, pp 85- 
92. 

Paiiiqli, W M Implication of Gestalt Paychology Quarterly Journal of 
Speech, Feb , 1929 

Woolborfc, C H Psychology fioin the Standpoint of the Spcccli Toaclici 
Loc cii, Feb , 1930 

MVobbeij II A Good Pinctice Judgment Viohnisl, Vol. XLIX, No 0, 
June, 1929, p. 190 

KwalwflSiCi, J Music Aijpieciation, Is Ifc Vital? Music Supervisor's Jo^lmJ, 
Vol XVI, No 4, Miu , 1930 

^Mooic, R and Van Wtticis, M Tlio Child and iho Now Psychology Ti- 
broncs, Vol XXXV, Mai, 1980, pp U7*-120 



A caiOUr INTIMAOKNCE TIOT SUITABLE EOK 
YOlJNGEU DKAE CIIIX.DIIJCN 

U riNTNKll 

T('ih lu'H (’ollruc, (’oliiiiiliia IIiuvjmmUv 

Ui> to \\\v pu'Hi'nl luue nu K»«up IchI l\i\s bwi\ suitable 

for clukl in ilio boKiniiiiiK Knido'j (if (k*uf hcliool.s All of the 

Ki'oup U’hIk foi Iho Ji:ui<k's lU hoaiiug schools, 

such iiH llu' l)(‘lioit Fhbt (iiuilc, llu* Olis Ikiiimiy, llio Pintncr-Cun- 
mngluim, clo , niako use of verlml ihn'ctHUiH m giving llio tost, tincl 
liciiou mu not hiiilahle foi Ihe deaf On the oilier Jiiiiidj the Pintner 
Non-Uiuguiigo Aleiilnl 'IVsl, wlueh Ims proved to be well-adaplod for 
(leaf cJiilfheii is loo difTiouIt for deaf eliildieii ladow (he age of nine or 
tun TIenee llic inleUigouee of yining deaf eiiihheii fiom about age 
five to nine lias not so far been mensiualde by means of gioup tests 
Tlio new Piniiier Piminry Non-langiiiign Mental Test‘ would seem 
to fill tins gap 

Tins pi’iiiiaiy iion-laiigiiage teal was eoiiHtiuclml foi llio nK'asiiie- 
mcni of infolligence b(*low the range eovered by thi' Pinlnor Noii- 
langiuigo Test, whicili is of IiM.le or no use below (bath' If Like the 
latter, it is non-verbiil in content iind inalveH no use of languiige m 
the dnoelioii's These uio omued oiil by means of panlominc mid by 
examples of piocediiro peiforined on Iho blncJclioaMl It was eon- 
sfcniclcd as a non-language test foi kmdergaitoii, Cliatle I and Grade 
II, ao ns to enuntomet any language handicap that may be present 
among young oliildrcn coming fi<im Jioiiies of varied amounts of funiil- 
lariLy with Iho Englisli language A leceiU iiy-ouL of this test in 
two deaf scliools woidd seem to i»ho\v that it has decided possibilities 
as a group test foi ilio young deaf school child 

The test itself consists of four sub-tesis In the fiist the subject 
has to nolo Uic object or pictuio held up liy Lho exannnei and then 
find this object among the picUiren in llie lest booklet and mnik it 
There am nine such ilenis Sub-test Iwo culls for tho completion of a 
geometiicnl form, the corioct foim being aUvnys m vh'W as a guide to 
the subject 'The third sub-test viMpiui's iiie completion of u face, 
each item having viirioiig p.u't3 of lho face ojnitled T’lie last sub-test 
icqiuvoB the subject to note tho position of the arms of the csamiuer 

'Published by the Buiean of PuhliciilHniK, Tonolioin t'olloge, Colimihia 
University 
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and then draw them m the coned position on the appropriate picture 
of a manikin m the lest booklet The lost is difficult to give and 
rcquiies much preliminary robeoraal on the part of the examiner, but 
given properly it can be understood by chilclren enteTing school 
for tho fiist time either in the kmdoigarton oi first grade, 

This tost WAS given to tho lower grades in two schools for the deaf 
for the puipose of testing its suitability foi the young deaf child.' 
Practically all of the childicn in the lowest giades m both schools were 
tested and a sampling of older childicn m order to see how fai up the 
test would bo discuminativc In all two Imndied ninety-three chil¬ 
dren were exaiumcdj ranging in age fiom age foiirto age fifteen, Table 
I shows the fiequcncy distiibutioii of the scores by age foi all childicn 
tested, Up to age eight inclusive Iho cases aic fniily w'ell scattered 
over the total range of scores; but from age nine onwnids tho cases 
begin to bo bunched at tho upper end The median scores lise steadily 
from ugc four to ago nine, whore they reach a level It is obvious, 
bhci’cfoiG, that the test is too easy for age nine and above The lack 
of zeio scoics at any age would seem to indicate that the test is not 
too difficult for the oidimuy dcuf child duimg the first few years m 
school It would seem, then, that wc have here a test suitable for the 
young deaf child between tho ages of four to eight, a period of develop¬ 
ment not covciccl at present by any other suitable non-language group 
intelligence test Tho content ot the test piovecl of interest to the 
childicn Tho Icachcis of the deaf children commented upon the 
suitability of the content and piescnlation of the tost foi deaf children 
So fai this test lias not been adequately standardized on heaimg 
childicn, but a compaiison of tho deaf children’s scores with tho 
tentative norms for the hearing may be of intoiest Tho results up 
to the present time arc as follows. 
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11 

45 1 

55 
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40 

56 

61 


' TliO ivriLcr wishes to aclcnowlcdgc the splendid cooperation of Dr Hams 
Taylor of the Institute foi the Imptoved Instiuctiou of Deaf Mutes, and of Miss 
Carrie Kcaina of P S 47, Mnnlmttan Two giaduatc students, Mi Ciiestei 
Bennett and Miss Elsa Itichaidshad charge of tho testing and the wiitei is indebted 
to them foi thou caicful woik 
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I’ho hip;U hwu e toi the fivc-yodi-oUl (h*iif is upon only mne 

cases and llie^e piobubly lejiiWiit a v(‘iy superior Rioup At the 
other three nges, where we liave i\ bellei »ani])bng of deaf children 
the scores luo about tlie, minu* as those for laniriiig childicn This 
result is 111 inaiked conlruHt to nuwl ooininuisons bi'iween the deaf 
and hearing on group intelligniee teats, wJieie the deaf aic usually 
veiy far lieliind lh(‘ liearing. It may bo Unit our tentative norms 
for the hearing me too low, or that (lie deaf cliildnsn tested area 
much fiupt'rioi Hainpling to duaf eliildieii m geneial Fiirthei work 
with both deaf uucl hearing oluldien will clear up lliese points. 


TABi.n I —J^ifiriiinuTiON oF yeoiiKS nv Aon (.tuoura 
Age 


Hcok'h 

-1 

f) 

0 

7 

8 

0 

10 

11 

12 



15 

70-() 




3 

3 

(1 

8 

0 

8 

1 

3 

2 

on-i) 



1 

1 

12 

21 

20 

14 

10 

.■) 

2 

2 

t)0-'t 



1 

4 

13 

13 

IG 

5 

2 

1 



5r5-o 

, 


7 

8 

U 

4 

A 

o 


1 



fiO-4 


1 

0 

8 

6 

1 







■iA-O 



3 

2 

4 

1 

1 

1 



1 


40-4 


2 

2 

1 



1 








1 

2 

1 









30-4 

1 

2 

2 

2 









2.5-0 

1 


1 










20-4 



1 

1 









l.'i-lO 

, 

1 

1 










10-U 

2 

1 











.'j-0 


1 

1 










0-4 













Total 


0 

28 

34 
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iO 

49 

31 

20 
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31 

40 

56 

61 

GO 

0.1 

08 

08 

60 

71 
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There la another possiblo oxphiniilion for this equality or superior¬ 
ity of the doaf child on this teal One of the examiners, i\Ti Bennett, 
bcliovoa that the deaf child has an ndvnntagn over tlie hearing child 
inasmuch as his whole training leaches him to pay more attention to 
gestures, facial expression nnd the like, and Jionco ho is better able 
to interpiefc the pantomimic inslvuctionB of the cxaimnei and profit 
moic from them than the hearing child does 
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A gioup intelligenoe lest for young children has been constructed 
winch 18 pi cscnled by means of panlomimo and examples on the black 
board, No language is rcqimed to undcistand the cliieotiona oi t< 
respond to the teal items. By moans of this test it is possible to tesi 
young deaf children in schools for the deaf It is the fiist group tesi 
aintablc for such enses. The results so fai obtained would seem t( 
indicate that it is diaerimmative for ages foui to eight inclusive. Thi 

deaf oliildien so fni tested slightly exceed the tentative norms for the 
hearing 



^YIIAT TS MEANT liY A d j'WCTOll? 

TIUJMAN T, K1CIJ,RY 


Haivtid 

'I'lui nititili' is ii> ihs(‘uss wlinl ooiwtiUUos the proof 

I,hill. II coiiitnon faclor is fn ncroiini for llio lotorcoriplaiions 

betwi’on u nunibor of vmuihlcs 'Hh* piiiUonlar oocuHion foi il ih the 
article by Piofeijfsoi IIolziiiKcr* m which lie unps ccrtiiin rliUii of inme 
as followa: 

Uy way of illustrating Uicso poiiils, wo may lake an oxninplo fiom Professor 
Kcllpy'e book (p WH ) Tbo foui li*sls used nro 

A’l « UoadiHi; Hpml 

A's « AulhiiiPliR pouei 

A'a “ Monioii forworda 

Ah “ Moiiioiyfoi inuniuDgrul Hyiulioln 

Thfi iiitprroiu’lalion and Iptiad (liffproiipis nii* «s taken fiom iv paper by the 

wnter.* 



A'i 

Ah 

Ah 

1 

Ah 

A, ‘ 


05HO 

u>r>o ' 

200f) 

Xt 

1 


1487 

•2489 

Xt 


' 

• 

0093 


Imi = - 010 ± 037 
tno « - 00,-) ± 037 
tun = 005 i 010 


From tlio inBignificiuico of thc<io totrads wo may concludo that factor pattern 
(1) with only 0 oomiuon i« iA\nic»enUy compU'x. If group factoiH aic jncsoiit in 
these foil) tcrtla thoir effect ih uiwigriificant, yet PiofpHsoi Kelloy einjiloys llu* pattern 
given by Uio following poiUon oC lua 'lable XII (oji ci(). NiunlenH in tlio table 
aro stniiilaul (leviationi) 


^ Ilolssingoi, K. J Tliojmlikc’s CAVD Is Pull of fr The Journal of Educational 
Psychology, March, 1031 

*lIo)«!ingci, K. J. On Tetiad Diltoienees of Ovcilnppmg Variables Joiitnal 
of fidiicationof Psychology, Peb , 1029 
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TCBtB 

a = liclorO' 
Bonoity, 
maturity, 
sex, race 

18 « 

Verbal 
^ fnobor 


A = j 

mornory 1 
[(leioT i 

c = 

spBcinl 

(actor 

f = 
speed 
factor 

1 Spocifio 

Not 

1 cbniice 

Chance 

1 Rending speed 

40 

60 



00 

38 

30 

28 

2 Arltiliinetla power 

21 


03 


31 

1 

10 

06 

3 Memory lot wonla 

Oft 

00 


&C 



30 

33 

4 Memory for menu- 









iiiBful symbols 

SO 



52 

30 


32 

, 30 


This happens to be a vciy false presentation of my argument and 
findings because the other elements in the pioblem have not been 
taken into consideration It is totally unsound to investigate foui 
variables, find that a single underlying factoi is sufficient to account 
for the mtercorrelations, and conclude that the same underlying factor 
(or any other, for that matter) would account foi the inteicoirelations 
of those variables when employed in connection with variables other 
than the four Awareness of this is fundamental to a study of mental 
analysis, and that Holzingei has overlooked it both in connection with 
Thorndike’s interpretation of CAVD and my interpretation of my 
tests IS unfoitunalc because it confuses the issues involved 

A brief presentation of hypothetical data will, I hope, make the 
issue clear Let us be given the following eight tests and let them 
be totally accounted foi by five underlying independent, i e,, uncorre¬ 
lated factors labelled a, h, c, d, e, as shown in Table I The constants 
are designated by hteial symbols, olhei than “c, with subscripts The 
chancQ factors that ordmaiily enter into measures have been omitted 
meicly for the sake of simplicity of picsentation 

Tjuild I 

rC] = mia -j- nib 

Xt — maa + o,c 

X 3 = »»8« + pjrf 

Xf = 

Xb ~ tnna + Btb 

®o = + nji + OtC 

x-j = + » 7 b 4* Pid 

a’s = H' Uih + 

With vaiiables 1 to 8, due to undeilying factoi s ns giveiij it can 
readily be sliown that Iho tetrads involving variables 1, 2, 3, 4, will 
equal zero, implying that one underlying factor is sufficient to account 
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for the intcnioii'ciatioufi Tins is tiur l)iiL the intercoi'i'elatiQns 
accounted foi iirohaj Mi, Ms, Mi, rn, and noiio other. The correla¬ 
tion ?i6 la not fificountcd for Viu’iiihio I lius just as much "right" 
to be considered in connoction with viiiiiihlG 5 us in connection with 
vaimblos 1, 2, 3 mid \ J)r UolzinKer’s u.se of my diitii is cqnivalont 
to iibstractuiK from a tubio, such us Table I, the first foui rows only 
and tin'll pointing; to the lack of evidence of faelors h, c, d, iind e 
Certmnly there is hick of evidence in the first four rows, but there is 
no lack of evidence m the Liible enlne 

Consider the data of Tiihle I All of the Lotuids involving j,, 
a I equal 2 Cio, and secoiully all Iho iolrads involving 
a-'S) also equal xoio. Cioarly one underlying factor is sufficient to 
account for the correliitions between the first four vaiiablcs Let 
us call this factor g. Clearly one underlying factor is sufficient to 
account for the coiiclations between the last foui variables. Let us 
call this facior {/. The iioxt thing w to say that y =* (/. Aa a bit of 
verbalism it sounds reasoimblo but ih, in liuth, ubsiird, The fact 
that one invcatigaior findH a single underlying factor sufficient in a 
given sot of tests, and asecoiHl fimls a single undm lying facLoi sufficient 
in a diffeicnt set, is not evidence at nil tliat the tivo facLors arc the same 
In the Tabic I illuatuitiou (hey me euUiely (litTeicnt, being an a factoi 
in tlio first four tests, and a /; fnclor in tlu' last fmii. To generalize 
from the relationships found in four lewis to rclationshipa supposed to 
lie in the mind of man begs the <iiiestion, for doing ho involves tk 
assumption that llui foui testa Hiunple the entiie mental life. There 
IS no certain technique which levcala (he luttci, but Lho more cKfccnaivc 
in number and varied in inituio the loats employed, the moie likeli¬ 
hood that the rolalionships found lo luuloilie tests scores aviH icfloct 
relationships in mental life. 



THE GROWTH OF SOCIAL PERCEPTION IN 
DIFFERENT RACIAL GROUPS^ 

W N KELLOGG AND B. M EAGLESON 


Itttlmuft Uiiivoraity 


I Outline op the Pboblem 

Of tlui liumevous attempts to uncover racial differences between 
negroes and whites, the possibility of a distinction lu the ability to 
interpret facial expression seems paiticularly fruitful It may be 
aigued fcii' example that negroes should Vie less able to understand the 
emotional expression of white tndividuals because they have fewer 
opportumtiea as a class to observe whites in emotional situations. 
They would correspondingly bo supposed to be superior, however, 
in comprehending the expressions of the negro countenance. On the 
other hand, an ability surpassing that of whiles m the interpretation 
of emotional expression of all sorts might theoretically be ascribed to 
tho negio as an outgrowth of the gicnter propensities for emotional 
behavior which ho is generally supposed to possess 

One of the most direct methods of approaching such a problem 
IS to determine at what singe of development differences, if any, 
begin to appear. This can bo done by examining groups of children 
of each race, ut varying age levels, equated as nearly as possible 
m icspcct to intelligence and social status. G. S Gates® has alieady 
reported an investigation of the growth of social peioeption in four 
hundred fifty-eight white children fiom three to fourteen yeaia old 
Since liGi method is simple and the groups are carefully doBoribed we 
have taken hei lesults as leprcsoutative for white children, and have 
duplicated the expeiiment as nearly aa possible upon similar groups of 


' The wi iters wish to acknowledge the gcneioiia cooperation of the following 
pcisona, whoso assistance in giuntnig permission to enter the various schools and 
whose suggestions in the selection of diRcrctit social groups arc smcorely appreoi- 
nted. Mr Daniel T Won, Acting Supoiintendcnt of Indianapolis Public Schools, 
Mrs Grace L, Blown, Suporiiitondciit of Imlinnapolis Kindergaitens, Messrs, W 
N Giubba and E, W Diggs, pi incipals leapcotiYcly of Public Schools 24 and 42 of 
Indianapolis, nud Mi Antiiony Courtney, Principal of the Bannekci (ncgio) 
Public School 111 Bloomington, Indiana 

* Gates, G S ■ An ExpcTimontal Study of tho Giowth of Sooial Pciceptien. 
Journal of Educational Psychology, Vol XIV, 1923, pp 440*461 
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iiegincH. Tlio technuiiif’ ndopUul by Jias boon followod ineLicu- 
lovisly \\\ oulcv to luako the fiiulmRs vuUtUy compiuahlc to those she 
repoi Is Thfi only factor winch rernuina iincoiitrollod in our procedure 
is tho grographioiil difference in the loealions of tlic negroes nnd the 
whiLi's That this has introduced no Hpuiicnns iiilhiences will appear, 
we think, from the rcHiilts. 

II. lOxellHlMKNTVL (klNOlTlONB 

jMatcuah —Six pictures of the face, head iiucl shoulders of a 
woman in vaiious emolumnl poses weic hclecLod from tho senes 
published by lliickiniek » Typicnl mteiprolulions given by adults 
to ench of Iheae picUues arc as followi* ” 

Piptiiic A —Ijaiightoi', joy or amiisenieiil 

Picturo B —Pain. 

Piotuio 0—Angoi or defiftn^o 

Pirtuio D —l^ear oi lionoi 

Picture fi —Seoul, contoiniit or disdiun 

Picture F —Siirpune, womiei or anuiisenieut 

Tlip pniitfl wore presented “singly anil iiulividually'’ by a negress 
cxpcinncntei. Htico and w*x rehilionHliipH between experimenter and 
subjecta wore thus equivalent to tliose between Clates’ subjects and 
cxpcrimentors It should he noted^ however, tluit the emotional 
picLuies \voi'(‘ ideiitieal in both studies and tliat iliey weiG poses of 
a while woman. 

Method —A.ftev pielumnavy ofCoits to p\it the bvihject at case, 
his name and ago weic asked School grade and sex wcio recoided 
at the same time. The expciimeiiler then bind (1). “1 am going to 
show you some picLui es of ti lady, and 1 want you to tell mo what she is 
doing.If no response, or if an incoiioct or doubtful icsponse was 
made the subject was asked (2)* “What is she thinking aboiif^’' nnd, 
after a pause (3): “How docs she feel?" Ilepliea to those questions 
were recorded verbatim. 

Tho problem of grading and cloiiaifying the uuhwers accurately, 
particularly those of the younger children is, aa (lateH lias pointed out, 


'lluokmick, C. A.'. A Prohmmaiy Slinlv of llio Emotions Psyc/ioiopical 
Monographs, 1921, Vol XXX, No 130 (Oitical ntul ICspoiiineiilal Studies 
in Psychology from the Umveipity of Itlmoi^), pp. 30-36. 

^ Cf either lluckmickoi Qatcat Op cit. 
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a difficult one. We endeavored, however, to adhere stiictly to the 
criteria established by her Those responses listed ns correct oi 
incoriect for white children were similarly classified throughout this 
experiment A few answers wore leceived, however, which Gates does 
not report, in those cases “any interpietation which expressed the 
general trend of feeling in the pictuic was counted coirect 

In scoring, the piinciple of giving the subject the benefit of the doubt 
was adopted Thus when it had been necessary to ask two or three 
of the expeiimental questions the answci to one of which pioved accept¬ 
able, the subject was allowed oiedit foi Ins best answei unless replies 
to the lemammg questions clearly indicated that he had no compre- 
lieusion whatsoever of the expression pictured 

Subjects —Thiec hundred thirty-two iiegio school children whose 
ages ranged fioin tluee to fourteen years were selected for tins study 
from as widely varying social levels as were available m the vicinity 
of Indiana Univeisity The total number employod was divided about 
equally between boys and girls Ninety-three of the gioup, represent¬ 
ing all social strata, came fiom the only negro public school in the city 
of Bloomington, Indiana, a community of approximately 18,000 popula¬ 
tion Of the remaining subjects, ninety-eight weio taken fioin Public 
School No 42 in Indianapolis,^ which is located m a middle and uppei 
class negio district A third group, numbering one hundred eight, 
oame fiom Public School No 24 of Indianapolis, which was chosen 
as representative of the middle and lower stiata of coloied families, 
Childien of ages three, foui and five were tested in the Planner House 
Kmdorgaiten and Day Nursery and m Kmdcigaiten No 4, both of 
Indianapolis A rough classification accoiding to intellectual ability, 
as estimated by teachers, was obtained foi all subjects six years and 
over m ago 

By those selections the authors feel that a fair sampling of various 
social and environmental levels of the typical ui ban colored population 
has been obtained 


III Results 

Co‘)npa7isons between llacial Groups .—The summarized findings 
foi all subjects, regardless of social or intellectual status are given in 


^ All the schoola visited were exclusively negio institutions, including teacheis 
and piincipals 
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Tablo I. L'iRvwi^K of tbia table lue the pci cents of coircct interpreta- 
tions, picLuio l)y piciiire, arranged according to llio ages of the rcapec- 
tivo BUbjCCtf) 

Aside fioin minor vauiilionH the dula inclicato bubslautially 
the same faclH brouglit out in CSalos' atudy of wluto childien, namely, 


'XAni.B I - Pull CJbnth ofc* (JtmitKj t IIksi>onbi.h I'l.u PiCTUitij roll TirnoK IIundkeo 
T iniif^-*rwo Nnono tiiiii.inum 
(All Groups Combmctl) 


Ages . 

3 

4 

C 

D 

7 

8 

0 

10 

11 

12 

13 

14 

Picture A (IniiglitGr) 


7f) 

11 

87 

73 

83 

.07 


88 

94 

86 

(11 

Piotuio B (panO 

00 

■nil 

46 


Ki3 

70 

80 


72 

KTI 

.74 

83 

Pictuio C (angor) 


.13 

Wmi 

47 

.61 


02 

70 

78 

87 

88 

.00 

Pjctuio D (fear) 


mi 

.16 


36 

37 

61 

07 

72 

74 

85 

74 

lecture E (Bcorii) 

Bn 

■ 


Bli 

Kg 

03 

00 

00 

13 

10 

.18 

.17 

Ticturo F (Burpriso) 


■ 





.11 

.12 

26 

35 

Wm 

34 

Number oC cahcs 

6 

8 

Im 


37 

30 

37 

33 

32 

31 

34 

35 


(1) that tlio perceutago of succoBsfiil msponseH li'iuls lo increase ^vith 
ago xegarcUoss of Ihc cmoUonpl oxpie&hion jmlgrd, and (2) that the 
gencial order of poiceptibilily is, with occnsioiuil (‘xccptions, as 
folloTvs: Laughter, pain, angor, fear, wiipiibo and scorn. The per- 
CDntnges of siicccs.sful responscH of Uio iiogio cbildicn exceed those 
of the white children (as shown in Gatos' Tuhh' V, p 4G0) more times 
in tho inlcrpietalion of the Picture D (fear) than with any of the 
other expressions. It is doubiful, however, if any pnrLiculai sigmfl- 
canco should bo asciibed to this le.sult. The findings on the whole 
arc stiikiiigly similar in tho two exponraenta 

One point of some significance winch appeals in the figures of 
Table I is tho tendency of the pcicentages to drop for many of the 
pictures at ages thirteen and fourteen. An OMimmaiion of the 
analogous data for wliile childicn brings out the same sort of decline at 
the upper ages. The drop is probably to be uccouiiU’d for, wo think, 
by the fact that tlic older children who roiuain in school (wlicilior white 
or colored) lopresont tho lowoi iiilelligcnco levels foi then ugos, and 
Would conscciucnlly be expected lo bo infcnoi in social perception 
when oompaicd with subjects slightly younger than tlionisclvos 
In Table II wo have i*cconiputcd Gatos' pcicentages foi white 
children, combining the results for all six prints, ? e , without considera- 
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tion for the emotion depicted. These data are lieie paired with the 
similar figures of the negro childien ^ 


Tadi^e II—Pan Cents op SuccEssi-uii Responses op Whites and NEonoEs 

(AIV Pictuios Combined) 


Ages 


B 

5 

6 

7 

8 

9 

10 





Whites (fioin Gates) 









■ 



! 

Per cent i 

25: 

26; 

28 

35 

39 

39 

49| 

58 

73 


60 

77 

Numbfii of cases 

mm 

Kiil 

85 

mm 

55 ' 

58 

39 ' 

28 

1 44 

27 

17 

8 

Ncgioea 













Per cent 

HQ 

15 

27 

31 

38 

43 

51 

67 

.68 

61 

63j 

61 

Number of oases 

5 

8 

20 


37 


37 

33 

82 

31 

34 

1 

35 



Pig 1 —Growth ourvea showing scores of negroes and whites ns gi\ on in Tablo II 
The scores of the whites nro not consistontly suponor to thoao of the negroes except 
nt the younger ogoa whore tho white subjcels wore highly soleotccl (aeo text) 


Disregarding for the moment, the percentages below year five, we 
see that m six of the remaining ten age-groups, the values obtained 
by the coloied children eilhei excel those of the whites or approach 
to within two points of the results of the whites There appears 
therefore to be no obvious tendency for the samples of either race to 
be superior to those of the other in this ability.^ The peicentages 
foi years thi’ee and four are not validly comparable since our figures 


' The percentages weie computed by dividing the actual succesaea, logaidloss of 
the type of e\prG3Sion judged, by the total possible successca (=* the number of 
cases X 6) 

2 The icliabilitios of these differences were not obtained 
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wore obtained from nverago ooloicd children while the majority of 
Gates’ subjects of these ages came fioin "the Kindergarten of a 
select private school.” 

Intellectual, Set, and Social Classificaltons —Percentages in Table 
III {vide m/m) wore obtained m the same manner as those of Table 
II, except that the data were subdivided into tliiee classes accoiding to 
teachers’ estimates of iho intelhgonco of the children 


Table III — Ppn Cents of Succfsbscs of Gnours Classified AccoiioiNa to 

iNTBbliiaUNGD 
(All Schools Combined) 


Ages 

Q 

' 7 

8 

0 

10 

11 j 

12 

13 

. 14 

Group X (siipeiioi) 










Per cent 

33 

4i 

46 

S3 

m 

06 

62 

73 

07 

N 

Grou)) Y (iiviuago) 

8 

12 

0 

12 

13 

13 

10 


10 

Pci cent 


44 

■nil 

64 

so 

58 

01 


05 

jV . 

Group Z (inrenor) 


11 

10 

IS 

0 

11 

12 

12 

10 

Per coni 


29 

33 

45 

68 

40 

01 

57 

.54 

Y .. 


14 

11 

10 

11 

8 

9 

12 

16 


Group Z, with few exceptions, is lower in social peiception at 
all ages than either Groups X or Y Group X shows little superiority 
over Group Y except in the Inter ages, namely, cloven, twelve, thiiteen 
and fourteen. There thus appears to be a positive relationship of a 
crude sort indicated in oiu figures between social peioeption and 
intelligence. The failure of the X group to demonstrate its supeiioiity 
over the Y gioup at the younger ages is probalily to be explained ns 
a function of the inaccuracy of our method of measuring the 
‘‘intelligence” of these subjects 

Accoiding to Gates: “Sex difTeicnces arc not manifest and differ¬ 
ences caused by social status, ii they occur, me slight ” Tins applies, 
of course, to her experiment with white children. No hguics aic 
given to substaniiaic these slatcnients Our own icsiiUs, howevci, 
indicate a rather pronounced aox diffoionco, as shown m Table lY. 
The boys arc supcrioi to the girls only in the younger ages (where in 
moat instances the number of cases is small) Kiom seven to fourteen 
years, on the other hand, ^ils exceed the boys. This supeiiority is 
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to be explained no doubt as a result of the more rapid maturing of the 
girls The female subjects, actually m a moie advanced stage of 
development than males of the same age, would hence be capable 
of bettei performance in mental tasks 


Table IV. —Peii Cents of SuccEssEa op Nbqiio Boys vs Nboho Giuls 
(All Schools Combined) 




Fiq 2 —Growth ourvee showing relative scores of iiogro girls and negro boys oa given 
in Tablo IV Above ago 6 the scores of the guls deuionatrato a consiatont tendency 
to bo slightly higher than tlioHO of bo>s of tho same ngoa 


Differences between the majoi gioups of the three public schools 
arc indicated m Table V Two rather stiiking facts appear fiom the 
data in this table’ (1) The subjects horn the Bloomington school are 
superioi to those of cither of the other schools in five of tho possible 
nine age-gioups, (2) the subjects from Public School No 42 (presuma¬ 
bly from average to superior social levels) exceed the other two groups 
at only one age 

A compaiison of the two Indianapolis schools, year by year, dis¬ 
closes that neither is consistently supeiior to the other The subjects 
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from these two schools were sppcifically selcctod, liowovorj because 
of differences m environmental levels It is indicated, ilicrefoie, from 
these figures that distinctions in social strata aic of minor significance 
in the (Icvclopineut of bocial perception TJie general supeiiority 
of tlie Bloomington children over the other groups can bo accounted 


Taiile V,—Pna C^nth op CounnuT llrspONsm son Dipfriient SociAh Gnoors 


Ages 

0 

7 

1 ^ 

0 

10 

11 

12 

13 

! 14 

Bloomirigton 

Per cent 

29 

35 

48 

60 

60 

,06 

76 


m 

N 

7 

g 

10 

12 

11 

11 

8 



IndianapoliB public Bcliool 
No 42 

Per cent 1 

.3a 

30 

.42 

61 

66 

.60 

! 

.03 



N 

n 

10 

8 

13 1 

10 

10 

10 



Indianapolis public school 
No 24 

Per Cent 

31 

40 

30 

63 

04 

68 

61 

61 

60 

N . 

12 

12 

12 

12 

12 

11 

13 

12 

12 


for by the fact that in this small school two or threa giadcs are kept 
together in a single classioom. The continual contact with those 
older than themselves, afTorcls the children gicntcr opportunity to 
become adept in social perception than would be possible if they were 
segregated in separate classes. 

IV Stjmmahy and Conclusions 

Following the procedure adopted by G S. Gates for incasui'ing the 
growth of social perception in white ohildicn, three hundred thirty-two 
negroes varying m ago fiom three to fourteen years wore similarly 
tested. Six pictures of the Ruckmick senes weie presented one at a 
time to each subject who then attempted to iiuUcate the emotion 
represented. 

1. Regardless of geographical differences in tho location of the 
whites and negroes undoi examination and the fact that children 
of both stocks judged facial cxpicssions posed by a while woman, a 
striking similarity was evidenced year by year in the data for tho two 
racial groups. 
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2 The growth of social peroeptioii m negro ohildren was hence 
lTnTf“ Gates 

J,. *“ 

4 A rough positive lolationship appears between social perception 
as measured in this expeiiment and teachers' ratings of intelligLce, 

5 Groups of diffeient social status manifest no superionty in the 

mteipietation of facial expressions which can not be explained by 
lactois other than their respective social levels ^ 



ON ICIN RESIClMIiLANCES IN PHYSIQUE VS. 

INTELLIGENCE 

ilBXlUEHT S COKllAD* 

Iiiwtituto of ('luld WolfuH*, UiiiverHity of Cnliforiiia 

A niimbri' ot studios have poiiilod out tlio Riinilanty o! faimhal 
coofliciciUs of in phyMCiiI and in iyumUiiI tiaits Tlio 

inference, hy antiloKy, is UHiuilly tlmt Iho moiilul Luiits aio inherited in 
the same -way cind io ihti snim' I'xU'ht as tUo pliysicnl ^ As a possible 
objection to this, Spearman loiiR ago pointed out that the physical 
cocflicicnts of icsciiibUince aie iidalively unaltcnualod by tJie uniclia- 
bihty of mcusvu’omcni; whoroiiH iht luonUvl coellicioutb arc probably 
conaulcrably attenuated.*® One of our leading investigators in this 
field has leceiitly found the leM'iublunco of biljlings in intelligence to 
c’c\ual a cori’datiQU of .00 (ccuiccled for attenuation) He concludes:'* 

If we limy iieecpt Poaijfon'H losnlls foi the u'scinblnncc of HibliiiKfi in eve color, 
Imii colon nnd Gophalio indc\ (f)2, f>r», and 40), jind iPRiird W i 010 09 the 
tesomblmicc m\ traits onhrely fieo from om'mnmu'nlnl mflupncn, v.oinivy inter that 
ihc tiiJlHcnfc upon inlclUgenec of such simtltailfj tn Pimirojinirnf as is caused hy bmg 
hiblinji Iwo lo four ycais a}><vl m age m an AwCncan fmnihj lo-tlay is lo raise the 
coirclalionfiom .52 hi (U) t 

This conclusion, while posHibly collect, can hardly be accepted 
solely on the evidence inesented by its niitlior Tho measure of 
inielliRoncc employed, consisted of “a selection of teals fvom slamlaicl 
instriimonts—the Institute of JOducalionnl Ro-seaich Tests of Selective 
and Relational Thinking, Geneialr/ation, nnd Oigani/iation Now, 
if the autlioi hud taken a smgie IcU fioin lus total mtclligenco battery, 
and compared the correlation of siblings in this lesl with fclie coiTclation 
of siblings in (say) eye color, tlic compavi.son might have been 
acceptable Rye coloi is, apparently, a idatively simple trait, dctei- 
mincd by a small number of genes, and perhaps the score m a single 
test appioaches genetic! compiinibility; but the total score in an entire 


* TIjo inainiHBiipt liaa benofilixl fiom llio cuUiMsm of Di llobcit C Tiyon, 
National lle^ioaicli I'^cllow at tho Univomity of C«lif(nnin. 
t Italics ns 111 LIio original 

X Xlnougliout this paper, tho wotd "gonctic'* ir usod in tlic biobgiciil souse ol 
"hereditary,” or “pertnining to genes,” ncvci m tlic senbc of "poitaiiung to 
development,” aa m the toim “gonclic psychology ” 
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mlelligence tost is almost certainly too complex, for a comparison with 
eye color to be genetically significant. Most students of the constitu¬ 
tion of mental traits, from Spearman to Thomson to Kelley, appear 
agieed on at least one point* that the total score on an intelligence test 
represents a composite (with unlcnown weights) of several more-or-less 
intellectual abilities, or traits The statistical effect of merging several 
component tiaits into a general, composite tiait like "total intelligence- 
test scoie" 18 , m general, to increase—and, so fai as the comparison 
with simple physical traits is concerned, to spunoushj increase—the 
correlation between siblings in the general trait A precise evaluation 
of the spuiious use im correlation may be secured by applying Spear¬ 
man's foimula for the correlation of sums and aveiages ^ 

Let us, for example, suppose that the average con elation between 
siblings in each of eleven scpaiate tests is 52,’*' that is to say, 

j ii = .52, r^ii = 52, rgirr = 52, • • • Tuxi ~ 52 

This coofRcient coincides with the average found by Pearson for 
certain physical tiaits (eye coloi, hair color, and cephalic index) 
Now let us add the eleven tests to form a single battery or "intelligence 
test ” What is the corielalion between the siblings in this total 
battery? If the average mterconelation between the separate 
tests (foi the identical individuals tested on the seveial tests) be 60, 
and if the aveiage of the “cioss-correlntions" be .37—then, applying 
Spearman's formula, we find that the correlation between the siblings 
in the total test is .60 (see Table I) Would this increase fiom .52 to 
60 repicscut, as appeals to have been argued, the effect of enviion- 
ment, or would it lather repiescnt a necessary statistical outcome of 
the combination of individual tests mto a composite total score? 
Obviously, the coofficient of km resemblance which one obtains for 
“intolhgencc" depends to a maiked eitent on the numher oj tests which 


* Throughout thia illustration, all i^s os given me assumed to bo freed fiom the 
attenuation duo to uniGliability of measuiement 

Tho notation which follows is somewhat sjmilai to that of Kelley ^ 1 icfcia 
to Teat 1 ndministcied to the peisons in the X-distiibutiou; I lefcra to the same 
teat administered to the siblmgs of the persona m the X-disbribution, rn is thcre- 
foio tho conclntion between siblings m Test 1 Siinilnily, r^n is the eorielation 
between siblings in Test 2, etc In like fashion, tju would mean the “cross-corre¬ 
lation’' between tho scores ot persona in Teat 1, and the scores of their siblings m 
Test 2; rgiii would have a similar meaning for the alblmg cross-CDrielation in 
Tests 2 and 3, etc. See Table I 
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me merged into ike loial “i«felhj;rncc" score, a?i(l ike znterconelation of 
these tests. With i\ siwiablc haUory of tests called “intolligcnce” 
it aoems that almost any degree of sLhhnfi resemblance might be 
obtained.'*' 

Tabi^d I— Tun (JolmnI/A'rl{^^^ iiKrnhnN Sihmnch in a Total iNTEi-LtaBNOB 
Tebt, Di/naiMiNEi) vnoM Tiii^m CuniiKLATiOH in thk 8i,vaiiatb SiimTESTs 

^ _ + 

(/!■£+ J/)(i+iit- ..xn Va-l-<n*-n)fp,\/6 + (6*~^'WQ 

(/ + S + • //) nioniis tile sum of the hcoics m the cloven tests, made by the 

poisons in the A’-dtstuImtioii 

(I + II -)- • • XI) means thoflumof thcucoiosin thownmo cloven tests,mndoby 

the st6a of the porsouB in X-diatributiou 
a « t» » junnboi of teats ^ II 

fp, « the avorago intorcorrelatioii hetweeii the lesl^, for the pciaons in the A'*dis* 
tnbu tion « 60 

fpo « tho average mtorcouoktion between the IobIb, for the porsons in the F-dis- 
tnbiition = GO 

18 assumed to equal f-rQ, m this case, bccnusc the samo tests arc involved, only 
Iho aamplo receiving the tests diflcra nominally. (The samplo from which 
f j>Q IB obtaiuGAl conaiBta of Uio sihlinge of tKowuuplo from which fp, is obtained,) 
fpg “> tliQ average of: /•/! + ^/n + rim + ‘I-+ I'm 

* +l5l + l‘5JI + I'Sm “H *1’15XI *1" 

iiju -h riini + • riixi 

(Tlioro arc, m all, 11 coofllcicnta of coiidatiou with subscripts like fl, ;8ir, SlII, 
.^IV, etc., each of these conelations equals &2. Thmo me 110 cocfncionts of 
correlation with subscripts like ill, illl, iXI, SI, .0111, . 5X1, 51, SII, 

STV, , , SXI, otc , tho averago of thcao 110 "cioas*correlntiona,'’by the assump¬ 

tions of this illustration, equals <37 ) 

*(/+ff+ . 1 0(r+ui- xi) “ VllTTlSl'^UTCfiO) VlTT(12r-TT)W 

= 60 

* Some illustvationa of this from oxpciimcntal studies aio available. Starch,^* 
for evamplo, finds tho avovage coviclalion between eighteen pairs of adult aibhaga 
in toil separate achicvoment tests to be 42j in fivoaepaiato mental testa, the cone- 
lation is .38; but in nil fifteen tests combined, the coiiolation is 731 Soinewimt 
similaily, Jones* fmtla the conqlation between siiiglo parent nnd smglo child to 
crpial .648; but tho coiiclaUon of nvid-paiout witli mid-uhild (avciago ecote of ah 
fcliG childiou) IS .051. Willoughby,*® making iiso of fieoi(!,s in single tests only, and 
coivectmg for atlenuation, reports nn avcingo sibling coolbcicnt of ,42; this, as 
Toiman lOinaiks, is "out of line with (lower than) the lesults of other investiga- 
toxs,”'^* Theae "oUiov mvcBtigfttota" have, ui goncrnl, used total inteUigcueo test 
scores, 

t CJ Refereneo 6 



K%n ResemhlanGe% 


379 


It IS evident, then, that to measure a functional complex, like 
“ intelligence," and to assume this complex as a genetic entity,* 
may involve statistical difficulties Of course it is impossible, in the 
realm of mental chaiacters, to measure the strictly anatomical struc¬ 
tures to which the genetic entities most probably correspond The 
point hero is simply that the (different) ability complexes which are 
measured by (diffeient) mtelhgence tests are not, in any likelihood, 
the functional counteiparts of genetic entities '^Intelligence, ” as 
measured, demands analysis From this point of view, the mathe¬ 
matical studies of Rosenow,^ Spearman,Hull,® and Kelley® would 
appear of a fundamental nature, and not as objels d’ari It is, 
however, unfortunate that these useful and stimulating mathematical 
contributions have not more specifically considered genetic pioblcms 
and mechanisms 

Another statistical misunderstanding deserves mention. In re¬ 
viewing the literature one occasionally finds the statement, or somehow 
secures the impression, that because the coefficient of correlation 
between kin IS 20 (or 30 or 40, etc), the evidence for kin-resemblan.ee 
la strong In truth, however, a, con'elation of .20 or 30 or .40 la indiea^ 
tive not of strong similanty, but of fairly stiong dissimilarity A 
more legitimate asseztion from these corielations, peihaps, is that the 
evidence for heredity is significant. As a matter of fact, however, 
at least in the realm of mental traits, nobody knows (except by doubt¬ 
ful analogy with physical traits) what correlation should be expected 
between km, if heredity alone were the cause of resemblance. Nobody 
knows, because nobody yet knows (except very hypothetically) 
the mechamsm of menial inheritance t Serious argument from 


* By "genetic entity" tha writer meoDB a. single elementary which is caused, 
in part or m whole, by a specific genetic mechanism—whothoi unit-fnctor or 
multiple-factoi Thus, hjMc /oielocfc is a genetic entity (probably nrvit-factor), 
but handsomeness is not a genetic entity, because ffike intelligence-test score) it is 
a complex trait composed of several mdividual (and arbitrarily weighted) entities 
fR A Fisher^ and Sewall Wiight** have postulated ceitam caeflicienta of 
phenotypic resemblance between km, on the basis of certain assumptions coiicein- 
mg the mechanism of heredity Some of Fisher’s assumptions (paiticularly as to 
the numbei of genetic factors involved) may be doubtful in themselves, nnd Fisher 
himself admits that his wholo set of assumptions may be over-simple (such possible 
phenomena as lethal factors, somatic mutation, environmental effect upon domi¬ 
nance, diffeiential fei tiLity of goims, sexual selection, and the coi relation of Jieiedi- 
taiy and cnviionmental factois me ignoiod) Wright gives the most complete set 
of predictions known to the wiitei, but these piedictions me bused upon definite 
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empirical correlation coofiiciontB alone, Ihorcforc, Rooms as yet unjusti¬ 
fied To give oxlrcme examples for the cmphiiBia of this point: 
The coiTolatiori boLwcon parent and offspring foi trait X, in a pure 
inbred, homozygous line, would (if the parental enviionrnontalfactors 
aio uncorrelaLed witli the ofTspriiig's) he zoior* And yet this absence 
of correlation is oonsisLent with a quite piofound infiuonce of heredity, 
which, indeed, could uevov be deduced from the zeio coirdatiOTi 
coefRcient alone, oven if statistical allowance woie made foi theiestnc- 
tion of range in an inbicd population CJonvoiscly, the correlation 
between tiibcrciiloua infection in parents and tuberculous infection 
in olTspiing may lie quite high; hut this high coriohition is consistent 
with a negligible or oven zero influence of heredity (in the strict sense 
of thewoid). Peihapa the inohtenibnri'a.sHiiigsituation aiibcswhenthe 
conclation which might he expected lluougli Llio exclusive mfluenee 
of hcicdily, coincides with llmt which inigiil he expected through the 
exclusive infiucnce of environment 

A great deal of iiitiinsic inLciest nltaclies to the lolativc magnitude 
of km iGsemhlnnces in intelligence, height, ceplmlic index, eye color, 
etc. The point seems to deserve emphasis, however, that meiely 
biometuc studies of kin vesemhlivncc (umk’v uncontiollod conditions 
of environment), do not yet luivo tlio necoHsaiy psychological, genetic, 
and m/itiiojnalical basis foi anything like ngoi'ou.s, quantitative 
interpretation of results. ]«k\pmimeiil.al or pio-expeiimcnial studies 
of the type of Burks/^ Fieenum,-® Mullei,^ Newman,*“ Gesell/ 
and Tryoid" seem indicated. 

Noth—D iiiciissioii of Uie fuiogonig piipei with Di. Tryon hns bioiiglit foitli 
tlics (oilowiiiR 

1 The 1180 in coiiolnfion atlpiidiiiK tho pooling of losts may not be spiuious, 
111 llie sciiho that tlie iiso may hp iiilPipictcd m two ways (a) One possible cause 
of the rise may bo the elosor balnupingj m Iho poii\, of laetorsniieorrelatccl between 
the siblmgg (tlin accouls with Spoiumnn’s two-faotoi‘ tlieoiy of mental abilities), 
Wliclhci eithoi Iho gcmoiftl fnetoi oi the Hpeeifir facLoifl aio hcicditary or 
cnvnonmonlal or botli, is not divulged l>v tlio coiiplalioii cooHlcionts alone (6) 
All altoiimtive causo of the use may bp the fullct Hainpliiig of abilities in die 
pool tlinn ill any imlividunl lost (Una oppohIb with a iiiulLijile-factoi theory) 


nssiimpLioiia concoinuig both the mode of inliPiilniici’ and tlin system of mating 
In the case of liuman mental inlioutnncr, ignoianre of the mode of inheiitaiico 
would nppem to piechuk confidonlnBe of any onp of WnghL’s fomulto, 

* Inasmuch as a .leio coclliciciit icmniiia unnUered by tho collection for 
restricted range 
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2 A (liffcrfincG between puient-cliild correlations lu two psycl\ologicfl.lly 
unitaiy tmits may aiguo as well for a diffeient mode of inheritance as for a differ¬ 
ential effect of envnonmont 

3, In the compniison of coiiclntion coefficicnta, due consideiation must be 
given to the nntuie or make-wp of the vminblcs coneemed lb la woitli noting 
that the effect of pDolmg nasally thmimshcs rapidly, oa the biug of the pool irtcrensea 
This suggests the dcaimbility of compniing eithei simple elementniy tiaita, m 
which the effect of pooling is absent; oi highly complex tiaita, in winch the effect 
of pooling 13 lanly stable, and pcihaps uniform 
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A NOTE ON METHODS OF MEASURING RELIABILITY 

T G FORAN 


Catl\oUc UniVGtsity o( America, 

Tliree procedures aie available for measuring the reliability of 
tests According to the first, the same form of the test is administered 
twice The second involves estimating the lehability of the entire test 
or scale from the correlation of its halves. In the third method two 
forms of the test, each given once, furnish the data from which the 
meaauies of reliability aie calculated. The third procedure is genei- 
ally prefeired to the others All methods involve obvious diffciences 
under which the leliability of a test is found. 

The data m this study were compiled for the purposes of comparing 
the first and third methods as described above Four schools weio 
used In one, the fiist list of the Morrison-McCall Spelling Scale 
was given twice to all pupils from the Grades II to VIII, inclusive. 
In the second school, the second list of the scale was used twice In 
the third school, the first and second lists weie used m that order 
In' the fourth, the second and fiist lists were used In all grades of the 
four schools, a day intervened between the firet and second tests. The 
lules for administering and scoring the tests stated in the scale weie 
followed precisely and all computations were performed twice on a 
calculating machine. 

Identifying information, means, standard deviations, and seveial 
measures of reliability arc piescnted in Table I. The averages of 
the reliability coefficients are highei when the same foim is lepeafced 
than when duplicate forms are employed All reliability coefficients 
with one exception aie higher when either List 1 oi List 2 is repeated 
than when the two lists are employed and comparisons aie made 
between the same grades in the four schools Nine of the twelve 
probable errors of scoi e are lower for the single form method Further 
confirmation of these results is obtained fiom the probable eriors of 
estimated true scores 

In oidei to render the reliability coefficients cliiectly comparable 
through holding the variabihty constant, each coefficient has been 
used with Kelley's formula* 
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with 2 or tlie laigoi standard deviation aibitrarily sot at 10 In 
nine of the twelve possible coiniiarieoiiH of tlio same giadcs m the 
four schools, higher cocfficiontH arc bPoiircd from the two applications 
of the same form In one of the three coinpiuisons in which the levcrse 
occunod, the difference is iieghgihlo. 

In Table II the ineaRvnes of relialiihly luivo been averaged. With 
throe gradc-groupg and two schools for each inelliod, six measures 
contribute to each of the uveniKca The difforonco between the 
means of the cocflicienlH of lelialiility appears to bo considerably 
gicatei Limn between the ifi’a. A better comparison is possible through 
the moasurea of improvement over chance. 



TaTU.K I,— MLAHUIlbS OK 11BI.IA1I1I.IT) Outaini.i) with Dipkbudnt 


Auiian<u:mijm’k ok Tbsth 



®PEacftro “ 07'16 — r 


•PEesiia = probable error of CROmalctl Iruo Bcoro = 07l6ir\/r — r® 
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Table II —Means or Six Mbabeubs op Rbliabiltoy for Each Abuanqembnt 

OP Tests 



Same foiiti 

1 twice 
(1-1, 2^2) 

Duplicate 

1 forms 
: (1-2, 2-1) 

r 

035 1 

S66 

li 

969 

051 

PE,ooro 

1 12 

1 49 

t e 

1 08 

1 30 

Total number of pupils 

416 

809 


The improvement ovei chance has been computed from the 
foimula '■ 

Ip = 100(1 - vr^) 

While tlio moans of the leliability coefficieuis ovoi-emphasize the 
difference between the methods, a substantial difference remains 
when variability is hold constant 

Tabic III contains the significance ratios for the combinations of 
reliability coefficients The significance ratio is the diffcienco between 


Table III—SiaNinoANCB Ratios op Dippbrbncbs between Heliability 

C'OEPPICIBNTS 


Tests 

Oiadcs 

Mean 

II, III, IV 

V, VI ' 

VII, VIII 

1-1 and 2-2 

-4 69 

-hi Go 

-2 92 

3 09 

1-2 and 2-1 

^2 7a 

-0 24 

4-2 15 

1 71 

1-1 and 1-2 , 

4-1 29 

-h2 94 

-ho 00 

3 OS 

1-1 and 2-1 . 1 

-1 00 

4-2 10 

4-5 35 . 

2 82 

2-2 and 1-2 

-1-8 78 

4-0 67 

4-7 04 

0 70 

2-2 and 2-1 

-1-4 60 

4-0 38 1 

4-0 93 1 

3 97 


the coefficients divided by the probable error of the difleiencc. The 
probable eirois of the diffeienco have been found by means of the usual 
formula ^ 

_ PEd,(t = VPEVi + 

' Ilolxingci, Knil J “Statistical Methods foi Students in Education ” Ginn 
and Co , New Yoik, 1928, p 166 

® Gavvett, lleniy E “Statistics in Psychology and Education ” Longmans, 
Green and Co , New York, 1926, p 171 
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Tho Hignificiinco ratios arc posUivc when tlic fivaL coefficient of the 
pail IS higher than tho second, 'riie means of the ratios have been 
found without regnul to the HigiiH of the ratios It is noteworthy 
that the order of the tests has no influence on tlio results when the 
tests aip similar foiins Tlie most iinporlnnl difTerences occur when a 
reliability coefficient obtained fioin (ho same form used twice, is com- 
paietl with tho lohability eoefiicienfc from sinnlar foims The signifi¬ 
cance ratios arc much larger for Giades VII and VITI combined than 
for Grades V and VI together In general, reliability coefficients 
from repeated tesl.s are significantly liiglici than the same measures 
found fiom one use of each form of the test 


TAiiLf, IV—Pii\(”iien EFrpeTH am) KguiViVunm k of op MonmsON- 

Mef'Aiiij SplmjImo Hcat.k 


1 

1 

Gifldrs 

Ordoi of 
lesH 

jV 

Difleiciico 

+ 

- 

II, III, IV 

1-1 


1 48 


V, VI 

1-1 

00 

2 85 


VII, VIII 

1-1 

00 

1 01 


Mean 

1-1 


1 98 


ir, III, IV 

2-2 

80 

84 


V, VI 

2-2 

m 

2 00 


VII, VIII 

2-2 

S3 

1 01 


Mean 

2-2 


1 48 ' 


ir, in, IV ! 

1-2 

243 

85 


V, VI 

1-2 

1.'32 


1 00 

VII, VIII 

1-2 

140 


1 18 

Moan 

1-2 



44 

ir. III, IV 

2-1 

12.5 

1 32 


V, VI 

2-1 

100 

1 83 


VII, VIII 

2 -L 

01 


71 

Moan 

2-1 


81 



Diffcicnco is poailive whon wcond lest has lughai inona Moans aic not 
woightoi! 


Some measuiG of practice effect under the same conditions is 
possible fiom the data at hand Table IV contains the differences 
between the means for all grades and schools. The practice effect 
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involved in taking the same test twice is considerable. It is greater 
for List 1 than for List 2, the means being 198 and 1.48 but this may be 
a sampling enor The algebraic mean of the differences between the 
two tests in the last six groups is + 19. There are some indications 
that List 2 IS more difheult than List 1. When the oi dev of the tests is 
1-2, the mean gain is 44 but when the older la reveiscd the mean gam 
18 .81 

CoNCIiUSlONS 

1. When allowances aie made for differences m variability, 
reliability coefficionts are higher for repetitions of the test than for 
aumlai forms. 

2 The order in which the tests are given has uo effect on the results, 
even when one foim la slightly more difficult than the othei 

3. The practice effect of taking the same test twice is estimated 
to be 15 times the practice effect from duplicate forms This obtains 
only for the Mornson-McCall Spelling Scale 

4, In view of the results of this study, it is important to consider 
the conditions underlying the determination of test lehabiliiy 

5 Using the method of two forma, the probable error of catimated 
true scores of the Mornson-McCall Spelling Scale (and probably 
for any well scaled spelling test of fifty woids) is 14 words. 



SAMPLING KJIROII OP TKTRAI) DIFFERENCES 

C SPEAUMAN 
Univciftity of Ixinclon 

In tli(i now provjLlent imago of the fornnilu for tho probable enor 
or vaiiancc of tetrad cliircrpncca,^ there la apt to be scant account taken 
of tho Bpeclal nssiimpUons upon which this foimula is based. One 
of these, namely that tho variables bUouIcI have a normal frequency 
distribution, is only clangeroiis when great accuiacy is wanted.^ But 
the other assumption can do much more haim; it is that the correla¬ 
tions arc measured by the ordumiy pioduct moment coofficientsj 
so that the variance of tho coofHcicnl 

d-,2 ^ (1 - r=)Vi^. 

One case whcic this latter assumption may be far from justified is 
that of coefficients which have been coriectecl foi nttentuation. And 
even worse is the case of cooflicicnta derived from any of the customary 
four-fold tables. On tlic other hand, the coefficionls denved from 
ranks (with the diffeionccs sqiiaicd) would not seoin to mtioduce any 
disturbance of appreciable siao. 

Of course, Iheio is nothing to picvout anyone from so modifying 
tho formula foi tho tetrad sampling ciior that it does become valid 
for any coefFicient required. All that liiiH to bo done is that in deriving 
tho formula the above quoted tr,® should be icplaccd by the variance 
which is appropriate to that coofTicicnt. Suoh variances can be found 
in any good textbook; for example, in those of Ilolzinger, Ganett, or 
Kelley 


I Seo tliG piGsont wntci’a “Abilities of Man,” nppcntlix, pp \-\i (except that 
on p. X, N slioulcl be replaced by 

5 See tin.s JouiiNAL, Nov, 1030, DisUuIji'ih of Tetiad Diffo)ence«3 
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AhnoimalPsychology^ItsGonceptsandTkeones, byH L Holhngwortli 
New Yorlc The Ronald Press Company, 1930 Pp XI + 590, 

A very distinctive as well as significant contiibntion to the field of 
abnormal psychology is Dr H L Hollingworth's latest book. This 
work represents a seiious effort to make the concepts and theories 
concerning mental abnormalities psychologically intelligible It 
also lepresenis a determined eifoit to systematize these concepts and 
theories The system constiucted has a logical place in it for facts of 
consciousness along with behavioi but the evaluations and reinter¬ 
pretations of materials selected for presentation can hardly be said 
to be characteiized by catholicity. Most viewpoints aie evaluated 
but the psychoanalytic—^labelled by Hollingworth, the psyclioana- 
logical—^is vigorously attacked. His own conceptual system is con¬ 
sistently applied. In this system the general pattern of mental 
activity, abnoimal as well as normal, is said to be characterized by the 
ledintegrative sequence "Partial stimuli now occurring function 
for former antecedents of greater complexity." Learning and sagacity 
are the two impoitant aspects of these pracesses "Without learning 
there could be no mental activity, without sagacity, mental activity 
becomes biologically and socially ineffective," Feeblemindedness is, 
accordingly “lelative inaptitude for ledintegiative activity." " Unsa- 
gacious redmtegiated responses give the picture of the psychoneuroses 
On the postural level such symptoms give the somatic, physical picture 
of hysteria; on the autonomic level, they comprise the complaints ol 
the neurasthenic, on the symbohe level they show themselves in fixed 
ideas, obsessive thoughts, moibid pictures and ruminations, as m 
psychasthenia." Psychotherapy consists in teaching the patient to 
substitute a symbolic for a postural or an autonomic response. Lack 
of space prohibits a fuller consideration of the fundamental con¬ 
ceptions in this system They aie the same concepts winch the auilioi 

389 



390 


The Journal of Educational Psychology 


has previously used in i cconsliucling tho facts and principles in general 
psychology. And the rnconstructioii is practically as thoioughgoing. 

In the Preface the author difTeicntiatcs his own interest in mental 
abnoimality as a stiulciit of natural phonomoiui fioni tho “everyday" 
interests of c<lucators or hygienists and the “tcehnologicar’ inteicsta 
of psychiatrists or clinical psychologisla. This implies to him a 
doimnani intoiest in concepts lathor than clinical pictuios, ideas 
rather than cases, principles rather than proccduics; in short, an 
interest in uncleistnnding rather than preventing or relieving mental 
abnormality. Many cases are presented—inoie than in some of the 
books which emphasize clinical pictures. The book ically contains 
more piactical foalures than the foiegoing statements imply. The 
chief leason, of coiiisc, is that m dealing with problems of human 
behavioi tho point of demarcation betwoen diagnosis and tieatment 
is hardly perccptiblG—the goal fiom the beginning to cud can bo said 
to be fuller understanding. 

The order of presentation ns well as the oiganization of the mate¬ 
rials m each of the twenty-five chapters is appnicntly the result of 
much conscious planning The outline is clear and the maich con- 
tinous. Tho book bcgims with a succinct chapter on the subject- 
matter and uses of abnormal psychology. Abnormal behavior is heic 
diffeicntiated from desirable behavior. “It may be comfoitable," 
we are told, “to bo noimal, since this will mean that we arc not con¬ 
spicuous, but normality, m the scientific sense, is nothing on which to 
pride oneself" 

Following the introductory chapter are six veiy compiehensive 
chapters describing historical and contemporary viewpoints. The 
only one that can not be passed by without comment is the one which 
purports to give a fair account of psychoanalysns. Theic is no deny¬ 
ing the vahdity of a good deal of the criticism Noi can one deny 
Hollingworth’s greater clarity. But one is tempted to add that at 
least some of the clarity is obtained by ignoring fundamental diffi¬ 
culties which confront psychologists who aie more conceined with 
people rather than concepts 

In the consideration of personality deviations the author first 
attacks tho simplci and more mcasuiablc deviations, advances to the 
"DwcllcTS of Neurotica^' and thence to the psychotics and other moie 
complex deviations. Two chapl<jr8 are given to the feebleminded, 
nine to the psychoncuroscs and one chaptei a piece to each of the 
following topics’ Stage-fright and dieam, stuttering and stammoiingi 
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aphasia and asymbolia, epilepsy, constitutional psychopathic states, 
pcisonality types and functional psychoses; and mental disorder and 
the effect of cliugs 

Objective studies of the neurotic and the feebleminded aie fully 
treated In the discussion of the neuroses more than the usual amount 
of attention is devoted to the contributions of Babbmski, Hurst and 
Rosanoff as well as those of Janet and Prince The psychoanalytic 
contributions of Fieud, Adler and Rivcis me piesented as Hcrbaitian 
conceptions of the neuroses. The icsult is inteiesting reading but 
can hardly be considered as more than a forced interpretation, a 
■waste-basket variety of oalegoiizmg Holhngwoith’s explanation of 
primitive behavior in terms of ledintegrativc sequence is no more 
realistic than Fieud's winch he ciiticizes—neither is based on actual 
anthiopologioal studies No moio convincing is the description of all 
Freudian forgetting as “ undeilearned material ” 

A critical evaluation of fictional neuro-anatomy, a valid ciiticism 
of Cotton's overvaluation of the r61e of infection in mental disoiders, 
a much needed emphasis on the idle of the learning process in the 
development of the functional disoiders, n healthy emphasis on the 
how as well aa the what of the thinking of the contributions con¬ 
sidered—these, in the opinion of the reviewer, are among the most 
pleasing as well as distinguishing fcatuics of the book 

H Meltzer, 

Psychiatric Clinic, Saint Louis, Missouri. 


The Guidance of Mental Gwwlh in Infant and Child, by Arnold Gesell. 

New York. The Macmillan Company, 1930 Pp XI + 322 

If parents and educators more frequently combined their avowed 
love and respect for little children with the sympathetic point of view 
gamed by scientific study of mental development, many child adjust¬ 
ment problems would be solved. Dr Gesell shows a larc appreciation 
and respect for childhood's complexities, and he beholds with wondei- 
inent the oidcrly progression of mental unfoldment which hia own 
techniques, skillfully applied, have revealed He shatters many an 
illusion and yet builds up oui faith in the possibilities of solving behav¬ 
ior problems. If in his enthusiasm the author verges at times on the 
sentimental and stresses the obvious, these tendencies do not detract 
from the soundness of the pnnciples discussed Theie is occasional 
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iBpctilion due to inclusion of picviously published aiticles which 
oveilap 111 content. 

Childien have not always been so Byrnpaihelically understood 
but tho growing tendciiey towiud cloai*cr conceptions of the purpose 
of cliildhood and parent-child relationships is rcvoiilod m the accounts 
of early nuifioiy scliool pi ejects and in the coircspomloncc of intelligent 
inotlieis of wliom Susanna Wesley wna an illustnitiou Older con¬ 
cepts of child guidanco aic illusLiuled with an amusing and charming 
senes of old prints and lithographs The modoin nursery school with 
its attendant piogiam of scientifiG child study is the newest addition 
to institutional cducalioii nnd promises to integrate tlio activities of 
home and school of chilclien below kindcrgaiten ago. Instead of the 
kindorgaiten giving formal iiiatruclion based on dubious psychological 
principles, we find the modern kmdcigiarlcii assuming an important 
r&lc in child guidance, forming n continum with tho nursery school and 
the elemontavy grades. 

Concerning the mental development of the child ag determined by 
the ingenious methods of the Yale Payclio-chnic, the author has many 
significant findings to ropoit Tho most impoitnnt piinciples formu¬ 
lated are those concoimng the rapidity, complexity and orderlineBs of 
mental growth, from birth to maturity. 

Dr GescU formulates normnlily of mind in terms of. (1) Whole¬ 
some personal habits of hving; (2) wholesome habits of feeling; and 
(3) healthy allitudo.s of action 

Concerning the pail played in development of the two factors of 
heredity and environment there has been n gieat deal of misunder¬ 
standing Dr. Gcsell’s treatment of tho topic is one of the sanest 
and most intoresLing of cxiating leporta He finds that the child 
is remarkably well insulated against chance enviionmcntal influences 
and conditioning and that much of what in the young child appears to 
be the result of training and teaching is really tho result of mental 
unfoldment and natuial maturation. Because the child is a human 
being certain bohavioii.sUo trends aic bound to assoit themselves m 
spito of oven decidedly ndverso cnvnonmontal conditions Physical 
handicaps do not drastically alter the behavior capacities of the 
child. Tho inovilablcness and suroty of maturation safeguaids tho 
child against advontitious circumslanccs 

The validity of the conclusions ropoitcd is well established nnd 
their application in child guidance work will be unquestionably 
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beneficial Every one who has child training responsibilities will 
find Dr Gesell's book inteiosting and valuable. 

Gertrude Hildreth 

The Lincoln School of Teaoheis College, Columbia University, 


The Review oe Educational Research 

The fiist issue of the first journal to attempt a systematic review 
of educational lesoarch has just appealed The Review is the official 
organ of the American Educational Research Association which is now 
a Department of the National Education Association. 

The first issue deals with the curriculum It was prepared by a 
committee consisting of Br, Hcniy Harap, Dr. 'William L Connor, and 
Dr Ralph W. Tyler, assisted by several other persons. This issue 
includes an extensive classified bibliography and tieats of methods 
of curriculum-making, studies of the objectives of the curnonlurQ, 
studies of loainmg which bear upon the curriculum, time allotment 
and giade placement, etc. Foui othei issues dealing with teacher 
personnel., school oigamzation, special methods up to the end of the 
elementary school, and individual differences and psychological tests, 
are scheduled to appear during the year The whole field of reseaich 
has been divided into fifteen topics which will be covered m three years. 
Three numbers will appear during the spring and two during the fall. 
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OUR NEEB OF SOME SCIENCE 
IN PLACE OF THE WORD ‘INTELLIGENCE” 

C SPEARMAN 

I CoNTHIDUTIONS of PnOFESSOR DEAIlBOnN 

Not long ago the present writci venluied to oriticizo a bbok by 
Professor Deaiboin on “Inlelligeucc Tests lie has now been good 
enough to lespond;* and on one point at any rate I hasten to acknowl¬ 
edge a misunderstanding I had complained that his book, whilst 
referring copiously to the small and contioversial part of a work of 
mine,® had noverthcleas taken no notice of the laige and constructive 
part. In reply, ho now stales that his book, although published in 
1928 (June) consisted really of some old Icctuic notes written two years 
earhoi, hence, ho says, its contents did not refei at all to the said work 
of mine published in 1927 (March), but instead to anothoi work written 
by me as far back as 1922.'* Although not without surpiise at his 
manner of making books, I must admit that it has heie rendered my 
criticism inapplicable, and so, with apologies, I withdraw ifc 

However Piofessor Dearborn, after thus making his own defence, 
passes over to a counter-attack I will quote his own words, in order 
to render justice, not only to his puiport, but also to his style He 
charges me with “a biazen, if belated, effoifc to steal some of Bmet’s 
thunder,” and supports this chaigc by alleging that "Binot did 
have some ideas of Ins own, pieeiously like the common factor of 
Spearman ” 


‘ Houghton, MiHlin nnd Co 

“This Journal Octobci, 1930 

®“ThQ Abilities of Man,” Macmillan, 1027 

^ "Nature of Intelligence and Principles of Cognition,” Macmillan, 1922 
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To begin with, I should like to congratulate him on Ins choice of 

objective, Cfiitain ciifciesof our tlicoiy of Two Factors makeapretence 
of attacking it fundamentally when in truth they arc only dealing with 
unimportant details, what is really essential in our theory they tacitly 
appropiiate to thcmsolvcs (mostly under now niunoB). Not so 
Professor Doarborii. The point of attack ehoaon by him is both novel 
and vital Ho would appear to charge us with nothing loss than 
plagiausm; the very hub on which our theory rolls, the gciioial factor 
itself, this he new edits to our cailicst antagonist. Bind, 

Despite this tribute to his honesty at any rate, in another respect 
Professor Dearborn, to speak fiankly, is disappointing Since he 
takes up a position of such giavo moment, one might expect to find 
him ontienchcd behind a great mass of specific and cogent evidence. 
Actually, ho brings forward no evidence whatever. Although my 
own representation of Binot’s work had from end to end been accom¬ 
panied by citations of that writer's voiy words, Prof. Dearborn m 
his turn does not add a single new quotation; noi does he even indicate 
any fresh way of interpreting those cited by me. Instead of any such 
thing, he gives us simply his personal conclusions. Such a procedure 
may be well enough in the class room, or even in electioneering hustings 
But on the aicna of scionco, just as in the couits of ju.sticG, I submit 
that it is too high-handed, Wc rcquuc the actual facts on which the 
asscitions claim to bo founded, so that wc may have an opportunity to 
examine such claim for ourselvca. 

II Dilemma, of Binbt 

Attempting to make good this default on his part, lot us first of 
all see what was the standpoint of Binet before the appeaiance of 
“'General Intelligence,' objectively determined and measured,”^ which 
was published by the present writer in Apiil 1904, and already con¬ 
tained all the essentials of the theory of Two Factors In particiilav,its 
main object—as shown m tho very title—was to intioduce a “general 
intolhgonce” that admitted of mcosuicmcnt by tests. Before this 
publication, the standpoint of Bmot seems to have been most char¬ 
acteristically expressed as follows* 

Wo pioposo tlio atudy of tho ton following procchses Momojv, the nature 
of mental images, iinnginEifcion, attention, tho faculty of undeiatandmg, aiiggesli- 
bility, the aesthetic sentiment, moral sontimcnt, muaculai foioe, and force of will, 
inotoi ability, and coup d’ooiL These aio, wo bohevo, mental faculties that differ 

^ American Journal of Psychology^ Yol XV. 
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greatly from one individual to auolhev, and aio such, that the knowledge of their 
state with nn individual gives ua a general idea of that individual.^ 

He then proceeds to supply us with several tests for each, faculty 
Memory is to bo tested by goometiic designs, phrases, music, and 
colours. Mental images, by the nature of the errors of repioduction 
Imagination, by ink blots, composition of pictures, and combination 
of words into phrases Attention, by regularity of reaction-tunes, 
and by success in counting two motionomes simultaneously Com- 
piehensions, by definitions, by peiception of resemblances and differ¬ 
ences of meaning, and by criticism of phrases.^ Of any "general 
factor he does not so far seem to have manifested any trace Indeed, 
even the term, "intelligence^’ does not appear to be mentioned And 
to the best of my knowledge, he made no ladioal depaiture from this 
standpoint right up to our aforesaid publication of the theoiy of Two 
Factors m 1904. 

But he ceitainly did so two years after that date. For then he 
and Simon brought forward their world-famous "Metric Scale of 
Intelligence ” They wiote. 

Our aim is in no way to study, to aimlyae and disengage the aptitudes of tlioso 
who are mferiov in intolligonoo That will be the object of a latei work Heio, 
we will loatiict ourselves to appreciating and measuring their inidUgmee in 
general, wo will fix their mtoHeotual level; and to give an idea of that level, we will 
compare it with that of normal children of the same ago, or of analogous level ^ 

But lioie, wo must undeistand one another on tho meaning of that word bo 
vftguo and so compiohonaivs: **mtelligonce’* Almost all tho phenomena with 
which psychology la concerncdaiophenomcnaofmtolhgoiice, a sensation, aprecep- 
tion, arc intellectual manifestations as much ns is a icasoning Ought we then to 
introduce into our examination tho moasuremeut of sensation, as is done by 
paycho-physiciats? Ought we to put into our t^ta tho whole of psychology ? 

A little lofleotion has shown us that that would bo a gicat loss of time Theie 
18 wihhin intelligence, so it scema to us, a fundamental organ, that whoso lack or 
porveision is of the greatest imporfcaneo foi piactical life. This is judgment, 
othciwiso called good sense, practical sense, initiative, the faculty of adapting 
oneself. To judge well, to undeistand well, to roason well, these aio the essential 
springs of mbclligonco ^ 

These words, at first reading, were dchghtful enough. For between 
this measurable “intelligence in gcneial” thus newly advocated by 

‘ Annde Psychol, Vol II, pubhshed in 1896 Tho date on the volume is 1896, 
but this, it appears, always icfcrsto the j/revious yoai (supposoly the time that the 
actual lesearch was effected) 

* Ibidem 

^ Ann6e PsychoL, Vol XI, published in 1906, see nbove. 

* Ibidem, 
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Binet iind the moasiirable ‘^geneial intelligence” intioduced two 
years earlier by myself, thoie seemed to be no difference. And as for 
his “fundamental organ within the mlelligence,” this appeared to be 
only a- epeoial mterprotation of our factor “p,” There are accordingly 
some grounds for concurring with Prof Dearborn to the extent that 
h\j this lime (1906) Binet did have the concept of a general factor in 
intelligence. 

But of any such likeness between his view and ours, Binet himself 
seems not to say a word. As I pushed on with the pei usal of his work, 
expecting every moment to come upon his expiession of cordial agree¬ 
ment, I encountered indeed a review of om theory of Two Pactois, but 
this only announced Ins disappioval of it, on the giound of it being 
“stulTed with mathematics”' 

The fact seems to be that, so far as theorizing is concerned, his 
adoption of our geneial factor was only half-hearted. He was torn, 
in two opposite directions On the ono hand, he naturally endeavoured 
bring his utterances into harmony with his new metric scale, But 
on the other hand, he continually regieased back to the old faculty 
doctrine, for upon this had been built up, and now stood iirevocably 
founded, his whole general psychological outlook Even m this very 
metric scale that we have been discussing, he flagrantly lapses into 
the facultism again; for ho expreMly assigns to each of his tests its 
own special faculty or faculties. Thus his test of cutting paper is said 
by him to be one of “voluntary attention, reasoning, and visual 
imaginatvon ” liis discrimination, between objects is called a test of 
“ideation, the notion of difference, and to some extent the spiiit of 
observation ” His repetition of digits is said to involve the faculties 
of “immediate memory and of voluntary attention” His test of 
pictures—to which he subsequently attributed such dominant impor¬ 
tance—IS here only taken as 'Mestined to seek whether thcie exist 
associations between images and their names ” In the second version 
of the metric scale published three years later, all such indications 
of special faculties to he measuied by the respective tests was, indeed, 
abandoned. But very soon afterwards, they woie re-introduccd and 
more explicitly than. ever. I*or now he goes so far as to write that; 

The mental faculties of each subject are independent and unequal Om* 
mental teats are always specific m theu" scope; each suits the analysis of a single 
faculty,I 


’ Lcs Id^ea modci nes sui les Enfnnts, 1009 
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In these words, the general factoi or “fundamental oigan” would 
seem to have quite faded out of the picture. 

But whilst thus in theoietical discussion ever regressing back to 
his ingrained faculiism m the actual practice of measuiing the logic 
of facts diove him iricsisLibly more and more along the new path of 
Two Tactors Already in 1900, as mentioned, he had indicated his 
intention to measuie the “level" of his “iniclligenco in general" 
But how was such a feat possible? The word “general" means 
something common to all or nearly all of a class, as exemplified in 
the phrases a “general direction" or the “general goveinment." 
But With the faculties, he himself stated (as we have just seen) that 
no such common level exists His sole resource was to take “ gcnei al" 
not in the sense of common, but m that of middle or average Such 
averaging, however, was just what we had advocated ahoady in 1904. 
Bjillinntly original, then, as was his proceduio in detail, in essence it 
WAS lollowing us 

HI. Limitations to the Validity op AviaiiAQiNG 

But was he here really onliMcd to follow us? Tlio procedure of 
averaging, wide-spioad and invaluable ns it is in both physical and 
mental science, has novevthcloss its limitations It is only legitimate 
when ceitam posUilatoa aio fulfilled One of these is the uncquivo- 
oality of the domain at issue You cannot, for instance, obtain the 
average lieight of an Amoiican without first settling who is to count 
as one And then, having got the domain definitely settled, it is 
imperative to take the whole of this into the icclconlng. Thus, you 
cannot claim to have got the monthly average of your expenditure 
during any year if you leave out of calculation, say, Decembei A 
thud postulate is that your leckoning should present no overlaps, 
thus, it would not do to bung in December seveial times Still more 
fundamental is the need of comparable units. You may indeed 
equally well derive your average expenditure by taking every day, 
or every week, or every month. But you would not be lationnl if 
you mixed up days, weeks, and mouths mdisciiminatcly together. 

Now, on the theory of faculties, one at least of these postulates 
appears impossiblo to satisfy, namely, that of finding any common 
unit by which the diffeicnt faculties can be bi ought into mutual 
connection Thus, how shall a common unit be found to make 
memory compaiable with judgment? We might lake the whole of 
memory as one single unit whilst wo divided up judgment into seveial 
kinds each constituting a unit of its own; or else equally well we might 
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take judgment aa "being one and subdivide the memory. The one 
basis for averaging would favor some individuals, and the other basis 
others Thus the score leachod by averaging becomes arbitrary, 
therefore invalid 

And the matter becomes much worse still, if we pass from the 
clear but untenable tlieoiy of faculties to the extremely vague theory 
of “mtelligenoc'’ commonly favoied. For here, all foui of the said 
postulates fail to be satisfied To find any common unit lemains 
as impossible as befoio. In addition, there seems no way of avoiding 
large omissions; for it would appeal hopeless to attempt to include m 
tho tests every sort and desciiption of “intelhgcnce." Furthermore, 
there appear to be no means of arranging that none of the tests overlap 
each othei, indeed, they often admittedly do so And lastly, no 
agreement seems to be feasible as to how the domain of this “intelli¬ 
gence” should be delimited, for some authorities want to include one 
thing and others others. 

Nor would the preceding difficulties be in any degree escaped by 
shifting from the notion of average to that of a “totality ” Foi the 
latter also would involve every one of the aforesaid postulates (even— 
as might perhaps not be expected—^that of a common unit). Nor 
yet would any relief be brought by substituting, as many later writers 
have done, the notion of a “sample.’^ For this too would involve 
the same four postulates—with other troubles superposed.^ To all 
this may be added that actually mental testers, far from having over¬ 
come these difficulties, have hitheito not so much as made any serious 
attempt at doing so. 

But what is sauce for the goose, it may be urged, is also sauce for 
the gander. If all this averaging is so irrational when employed by 
the facultista and the intelhgentists, how can it protend to he satis¬ 
factory in the hands of the two-factorists? The reply is that in the 
latter case all the preceding difficulties do surprisingly dissolve away. 
For in it, no claim is raised that tho result of combining together 
different teats is to constitute any rational average, or central value, 
or totality, or sample The sole claim raised is that, in such a proce¬ 
dure, the specific factors tend to cemeel out, leaving the general factoi 
alone dominant As was said originally; 

“Th .0 apecifio eloipont can to a great extent be readily eliminated by varying 
and combining the l<mds of test,” whereby the general factor or “ccntial func¬ 
tion” stands out in corresponding exactness * 

* "The Abilities of Man,” Chap. V 

^American Journal Psychology, Vol XV, April, 1004 
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For this purpose of oaneelliiig out, omissions or overlappings—unless 
they are highly systematic—do not greatly interfere Nor does oven 
the manner in which the units aie constituted. And as for the domain 
from which the tests are to be derived, this in the theory of two factois 
is no longer equivocal. Its domain extends to just as many abilities 
as may be observed to satisfy the two-factor cntciion. 

IV. Plea for an Awakening 

What is the upshot of all this? Not unnaturally perhaps, Prof 
Dearborn comes to the conclusion that, in apilo of all, the situation is 
well enough; that, even if the current procedure of measuring the 
“mental ages” and the “IQ’s” is indeed equipped with a wiong 
theory, it nevertheless admittedly is right in practice, which is what 
alone leally matters 

Now, it is just against this attitude of quietism that I would here 
desire to make a lively piotest For m the first place, even the prac¬ 
tice current in testing is only right with very eiude appioximation. 
It only succeeds evoi m yielding a definite ineasiu'emcnt at all if and 
when the sub-tests entering into the wholeteam of them are sufficiently 
numerous and selected at random Now some sort of randomness does 
derive from tho mere fact that these subtests are gathered together 
{rom highways and byways without any system oi plan But this 
facile mix-up is insufficient to secure that perfect randomness—in 
the sense of freedom from all bias—which statisticians mean by the term 
and which is needed to produce the dofimte ” In order to obtain 
such freedom from bias, the procedure should not be without all plan, 
but on the contiary planned with great care Whereas the present 
tcst-makeis, quiet light-heartedly allow themselves to be strongly 
biassed towards several objectives, such as ease of application, self- 
consistency, correlations with other things, and so foith. 

But tlieie IS a still worse objection to the curient procedure Even 
if this did happen to pioducc pure g (or any othei definite measuio), 
nevertheless when divorced fiom the Iheoiy out of which it sprang 
it would pay the penalty of foifeiiing all significance; the mei e average 
of sub-tests picked up and put together without rhyme or reaeon 
must needs present—at any rale until pioof is given othei wise—the 
very acme of meaninglessness. And as for the cuatomaiy dignify¬ 
ing of this gallimaufrey of tests by the title of "intolligenco”—without 
SQ much as an attempt really to construct them in accordance with 
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iiny explicit principle—this device comes unpleasantly near to psycho¬ 
logical chaiactenstics. 

Having regaid to these two defects, then, those of indcfiniteness 
and of meaninglessness, there is but small wonder that the current 
pvocodiire from time to time commitSi even in piacLice, blunders of 
great magnitude, so that there is only too good icaaon to suspect 
that many a child branded by test has theieby unjustly had hig 
career wieckcd And tins terrible fallibility of the tests is only 
lendcred the moie dangereus by the vast edifice of statistical data 
and calculations which aie often o&lentatiously piled upon them and 
which do but convert them into whited sepulohies 

But by ^Yhat manner of meansj it may be asked, is all this evil 
going to be made any the better by bringing on the scene the theory 
of Two Factois? Are not these also repeatedly charged with being 
entities of an obsouio, speculative, or hypothetical kind? To say 
this about the factors ia totally to misapprehend them, as we will 
now endeavour to show. These two factors, Q and s, do not in them¬ 
selves signify any entities whatever; they aie nothing moie than parts 
of actually observed measurements of ability And these part-values 
have at least the virtue of peifeot quantitative definiteness, that is to 
say they are, when taken rightly, “unique ” But to acquire scientific 
meaning, a furthor step is required, there must be proof supplied that 
these part-values, besides being definite quantitatively in themselves, 
also serve as measures of some qualitatively definite psychological 
functions And this, too, we may claim, has actually been done. 
In particular, the g has been found to measure “noegenesis This 
term denotes tlie following thice actually and piecisely obseivable 
mental functions The first is the knowing of our own experience; 
we not only feel, but know that we feel, we not only strive, but know 
that we strive, we not only know, but know that we know, The 
second of the mental functions consists in that, when any two or 
moro items are perceived or thought of, we may cognize relation 
between them, for example, we may become aware that one thing is 
like another, or is evidence for another, or is the cause of it An 
outstanding instance of this among testa is that of “synonyms and 
antonyms,’' where two words arc given and the testee has to decide 
whether they are very alike or very unlike, Thiidly and lastly, when 

iTlic "noB-’'' comes from the Gieck and mdioates that processes of this 
form alone piodiico knowledge The “-genesis” indicate that such processes 
alone gcTierate liew oogaitivo content 
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we perceive or think of any item and also of any appropriate relation, 
we may evoke the idea of the item which stands to the given one in 
the given relation. A. well know instance among tests is that of 
“opposites,” where the testeo is given some word and is told to say 
what is the opposite to it Those second and third functions are 
usually chavacteiised as "oductivc ” 

Whilst thus urging that the noegenetic processes are conceived 
m a maimer free from all indofiniteneas, we may take the opportunity 
to defend them from the ohai'ge sometimes raised that they are only 
of a “logical” nature, not of a “psychological” one What is heie 
meant by logical haa been left by these critics legrettably obscure 
But possibly the notion is that these kinds of process have little or 
no importance foi undcisianchng, anticipating, and controlling the 
course of mental life. In reply, we must claim just the contiary 
These three processes follow m general a settled sequence, and in 
such fashion that each piepares the way foi the following one. Thus, 
the awareness of one’s own experience supplies all the fundamental 
items of knowledge; next, between these items (possibly in some 
cases simultaneously with them) Iho lelaiions arc cognised, and finally 
the lelations thus furnished arc displaced to othci items and thus 
produce all correlative and novel items which are the mainstay of 
mental creation and invention, including that super-invention which 
IS behavioi.^ To recognise this sequence of the three steps and to 
explore the conditions which facilitate each of them should constitute 
one of the mam objectives of all functional psychology, including in 
particular its applications to crlucation, medicine, and industry. 
And all this is called “not psychological but logical”! 

More subtle and thciefoio still more dangeious than any such 
direct charges against the noegenetic analysis is the not uncommon 
practice of tacitly ranking it with meie unevidenced asseitions on the 
mattei For example, the view that mental tests involve noegenesis 
IS put on the same footing with the assertion that they involve 
adaptibility or educability, and so forth Tins is done regardless of 
the fact that the noegenetic view is based on the most elaborate and 
exhaustive measurements in all detail, whereas the other views have 
nothing behind them but iinsuppoi led statement 

But even tins establishment of g as being a measure of the ability 
called noegenesis is only the beginning, by no means the sum, of the 

^For a full but simple account of such displacement of lelations, lefeience 
must bo made to tlic piesont wiitoi'g “Cicative Imagumtion,'' Appleton, 1930 
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definite and scientifically aignifioaiit contributions of the theory of 
Two TactoTS. In support of this claim, appeal may bo made to the 
second part of ‘‘The Abilities of Man*' quoted on the first page of this 
paper. For this whole part is packed, not with anything obscuie or 
speculative, but with fundamental facts actually observed by a multi¬ 
tude of indefatigable workers duiing the past quarter of a century 
And to all this light which the Two Faetois have shed upon the work¬ 
ing of the mind must be added that which they have thiown upon 
tho ourient tests of the socallcd general intelligence For the g appears 
to constitute just that whioli is common to diffeicnt tests oi sets of 
tests, and thus to furnish the sole stable element in intelligence-test¬ 
ing. To this stable element, tho tests at present in use supply only 
crude approximations; what they contain over and above this g varies 
in an incalculable and theiefoio unscientific manner from one such test 
to another 

Theie is yet another objection commonly raised to the theory 
of two factois Here, the claim is advanced that this mode of analys¬ 
ing the scores made in a tost is only poiTnissive, not obligatoiy; other 
manners of analysis arc proposed—or moic often vaguely suggested as 
possible—to take its place. Against this attitude we must plead that, 
on tho contrary, there are places foi any number of different analyses; 
any two different ones msuy quite well be hoik of ihem true and even both 
of them valuable, or both of them the reverse. Faeh has to stand or 
fall independently, its fate must be settled solely by the amount of 
scientific information which it produces For example, the definitely 
observed fact that g measures noegenesis lemams quite unaffected 
by what any other factors arising from any different analysis may or 
may not happen to measure. If any factors othci than g and s do 
also happen to render useful services, then these services can only 
supplement one another, and thus enhance each other's values 

All in all, then, the plea is here raised that the current procedure 
of testing “intelligence" needs to be aroused from its self-complacent 
slumber. The present real baais of it is only a piactice that has been 
borrowed from another theory. And this practice fails to bo satisfac¬ 
tory because, when the practico was borrowed, the thooiy itself was 
left behind. By so doing, a saorificG was made of piecisioii; of mean- 
iugfulness, and above all, of an immense amount of observed funda- 
fental facta This disastrous situation has been largely masked, but 
at the same time really aggravated, by usurping the pretentious and 
wellnigh fraudulent title of "intelligence.** 
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Tlie purpose of this study was to determine whether motion picture 
films add to the effectiveness of mslvuetion which is designed to incite 
children to perform specific acts. The problem is one phase of the 
more general problem of the comparative effect of motion pictures and 
of other influences in guiding or modifying conduct. In this particular 
inatance the instruction, of which the motion pictures arc a part, was 
designed to influence conduct largely through giving clear-out informa¬ 
tion and pointing out the applications of this mfoimation to conduct 
The motion pictuies which weic used should have been chiefly of 
an informational nature to harmonize with the character of the general 
unit of instruction Suitable informational films could not bo obtained, 
however, and the films which were used weio oast in story foim. 
They were designed to appeal to the emotions as well as to the 
intellect 

The instruction dealt with the care of the teeth. This subject was 
chosen because it was believed that any change in the children's 
behavior as a result of msiruction could be more objectively measured 
in this field than m any other which was open to investigation The 
Elizabeth McCormick Memorial Fund, moicover, was in a position 
to provide systematic curriculum raatciial on this subject and to make 
contacts with officials of the Health Department of Chicago and of the 
Public Schools as a result of the co-opeiative study of other problems in 
health education. 


1 Thia study wns made possible by a giant fiom the Committco for the Study 
of tho Social Values of Motion Pictmosof the Payne Fund Giatefulackno-wledg- 
mont is also mado to Dr Geoigo Wandcl of the Amoricnn Dental Apsocmtion and 
Dr.Lon Moiroy of the Health Dcpmtment of Chicago for the loan of tho films and 
for assistance m tho piepavation of dontal lessons, to the Chicago Depaitniont of 
Health and tho Siipeimtcndenb of Schools foi the aaeistanco given in the dental 
examinations 
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The experiment was made m two public achoola of Chicago Two 
fifth and two sixth grades in one school wore taught with the aid of the 
films, while two fifth and two sixth grades m another school in a 
comparable neighborhood woie taught ■without the films In order 
that the instruction might bo comparable, except for the films, it was 
all given by the anmo person, Miss Mildred Dawson. Miss Dawson 
also served ns general assistant in the experiment. She is a very well- 
trained and compotont teacher and supeivisor. 

The instruction ivas given in thirteen periods, from May 8 to May 
22 incluBive. The following ia the outline of topics* 


Lesson 1 —ICnow yom teeth. 

Shape and function of tockli 
Lesson 2 —Stmoturo of tv tooth. 

Lesson 3 —Diet for teeth. 

Lesson 4—Diet for teeth. 

Lesson 5—Deciduous teeth. 

Lesson 6—Permanent teetli. 

Lesson 7 —Six-year molars 
Lesson 8 —or story. 

Lc'sson 9 —Malocclusioa and mastication. 
Lesson 10.—Causes of decay 
Lesson 11 —Picvention of decay, and review 
Lesson 12 —Caio of the teeth, and review 
Lesson 13 —Pilm or writing slogans 


Charts and diagrams wore used in the instruction of both groups 
to supplement oial instruction. The time occupied by showing the 
film to the experimental group was employed in reading a stoiy and in 
conducting an exercise m wnting slogans in the control group 

The two films which were shown to the experimental group are 
entitled Tommy 1 uoker’s Tooth and Clara Cleans Her Teeth The 
fiist tells the story of a boy who was refused a job for which he applied 
because of his unsightly teeth, but who later had his teeth looked 
after and was then accepted The second tells of a girl who enters a 
new school where the children have been trained lo care for their 
teeth, and who is ostracized because of the pooi condition of her teeth 
and her indifPeicnce to it. She, too, reforms and becomes socially 
acceptable to hei schoolmates. Some information is given in the 
films, but it 18 subordinate to the stories 

The effectiveness of the instiaction in the experimental and control 
groups was measured in four ways, namely: 
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1 An Information tost, given at the beginning and the end of the period of 
1118 true tion, 

2 A qucationmniQ in which the chiklicn. icpoitcd on the caic of their teeth 
(it home and the food which they nte, 

3 The mnfceiial bioiight in by the chilclicn, consisting of clippings of vaiious 
aoits, oiigmal mateiinl written by the childicn, booklets rctui, htoratme taken 
homo, and scoie cards which the chiUhcn filled out; 

4 Condition of the teeth ns detci mined by a dental examination given nfc the 
begmumg and at the end of the expciimcnt 

Results The Information Test 

The iafoimation tost was given at the beginning and tlie end of the 
experiment to both groups It consists of thirty-six multiple-choice 
questions. The questions relate to the structure and the development 
of the teeth, the causes of defective teeth, and the care of the teeth 
Through difficulty in tabulation, four of the questions wcie omitted, 
leaving thivty-two The information test is not a direct measuie of 
behavior Since the purpose of much of the instruction, howcvci, 
was to give information, it is important to know wliethor the films had 
any influence directly or inducctly upon the amount of information 
which the childicn obtauiod A comparison of the gains in information 
in the two groups is, tlicrcfore, presented 

Tlie differences in the average ability of the children in the individ¬ 
ual grades of the two schools was so gicat that it was thought neces¬ 
sary to make matched groups based on scoies on the intelligence tests 
and the initial scores on the infoimation test The matched groups 
werefoimed, not by matching individuals, but by selecting individuals 
from the two groups so that there would be an appioximately equal 
number in each class of the distnbutioii This foim of matching gives 
not only equal average scoies, but also an appioximately equal number 
at the various levels of ability 

Table I gives the data on the icsuHs of the information test fiom 
the equalized groups It will be obseived tUat the avciage intelligence 
quotient and the average initial score of the two gioups are practically 
identical 

It IS apparent that both the boys and gii Is of the con brol group made 
somewhat higher average scores on the information test than did the 
childien of the experimental group, but the difference is hardly statisti¬ 
cally significant. We aic safe in saying, howovci, that the films had no 
appieciable influence on tho acquisition of information This is, 
perhaps, not surpiising, since the films were not designed piiinaiily to 
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give mfomaUon. Tliey weie designed rather to make the children 
interested in caring for then teeth All we can say, then, is that these 
films, designed to awaken interest in the care of the teeth, did not stim¬ 
ulate the childien who saw them to acquire moie infoimation than the 
children who did not see them. Intcicst in acquiring information 
about the teetli 18 evidently somewhat independent of interest in the 
care of the teeth, aasuming that the films have stimulated interest in 
the care of the teeth. It is, of course, posaiblo that they did not stimu¬ 
late such interest The inference that the two types of interest are 
independent, therefore, la not concluaivc. It is contingent upon au 


Tablti I —The Scores op tub Equalized Eypbrimentae and Contiiol Grodps 
ON THE Information Test at tub Beqinninq and the End of tub 

Exphrjmjdnt 



li 

Avor- 


Aver- 


Aver- 


Equalized groups' 


age 

tQ 

SD 

ago 
Teat I 

SD 

age 

Test II 

SD 

Expoiimcntnl school 

Boys , , , . . 

5£ 

■ 

15 247 

14 01 

■ 

27 73 

5 9D2 

Girls 

53 

101.32 

11 474 

16 40 


23 62 

4,180 

Boys and girls . . . 

Control school. 

108 

lOt 16 

13 617 

15 16 

H 

28 17 

6 103 

Boys. 

60 






5 708 

Girls . . 

40 

[QIQ 

11 042 

16 41 



4 805 

Boys and girls . 

00 

IB 

14 236 

15 15 


29.36 

6 370 


‘ Equalized oa basis of sox, intelligence rating and initial score on information 
tost 


assumption for which we have as yet no ovidence. We shall have to 
hold the conclusion in abeyance, therefore, until wo have examined the 
evidence concerning the effect of the films in stimulating interest in the 
care of the teeth 

In order to discover whether the film was of special aid in giving 
particular items of information, the individual questions of the infor¬ 
mation test, which bore upon the activities involved in the care of 
the teeth, were tabulated separately. In only two questions does the 
experimental group give any clear evidence of being superior to the 
control group in the gains on the individual questions The correct 
answer to the first of these questions is: The motion of the brush should 
be up and down, and to the second: To keep the teeth in good conditiou 
we should eat some food that requires much chewing The method of 
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using tlie toothbrush was shown in both films, and the use of food which 
reciuiies chewing was shown m the film, Tommy Tuckers’ Tooth The 
superiority of the film group m these two questions, theiefore, is 
plausibly explained by the fact that the items of information or of 
activity to which they lefer arc specifically emphasized in the film 

Tub Results op the Questionnaiue 

At the end of the experiment, the children of both groups were given 
a score caid to fill out On this score card they were asked to report 
whether or not (1) they possessed a tooth-brush, (2) they brushed their 
teeth daily, (3) they used a dentifrice, (4) they ate vegetables daily, 
(6) they ate fruit daily, and (6) they drank milk daily. 

The results of the questionnaire are tabulated in Table II. The 
tabic shows the percentage of children of each group who answer the 


Table II Hesponses to thb Questionnaire on the Care of the Teeth 
and on Eating Given at Tan End oe the Expciwment 



PoBsoaalon Teeth 

of (Ootrh- bfUshed 
brush dRlly 


Ufte of 
(lonfcifrioo I c( 

d 



Per „ Per nor Vor .t Vor Per 

No . No. . No, . No. . No, . No , 
QQRb coat cenb aoab Gent conC 


ExpeiinventM oohool 
Boya 
Girla 

Boys and girls 

Control eohooli^ 
Boys 
Girla 

Boys and girls 


■ Reaorde of ton boya and ait girla moomplote duo to flbaonao 
^ RcoOrda of eight boya and four girls ineompleto duo to abaonco 


various questions m the affirmative. It is obvious that, if the childi en’s 
testimony is to be lelied upon, a large peroentago of both groups per¬ 
form. faithfully the act which they were taught to perform in. the 
mstruction Whether or not they would have given an equally good 
account of themselves at the beginning of the expeiimonb we do not 
know. On account of the high scores in both groups and tho uucei- 
tainty concerning the accuracy of the childien’s replies, small diffei- 
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enccs between the two groups arc of no significance. The only item oti 
which the dilTcience may bo significant is that concerning the daily 
brushing of teeth. Ninety-eight per cent of the children of the experi- 
mental group reported that they brushed their teeth daily wheieaa 
only eighty-ono per cent of the contiol group made a aimilai repovt, 
Since tlio films emphasize the daily brushing of teeth very strongly, 
this difference may be significant The film.s also emphasize tho 
other items, however, and it is not altogether clcni why there should 
be so much more difference in this item than in tho others. So far as 
it goes, the data suggest that when a particular action is strongly 
emphasized in a film the emphasis may be effective However, it is 
not at all eloai why tho control group should have fallen so much lower 
in blushing their teeth daily than in using dentifiice, or in eating the 
various kinds of foo d which were advised Taken altogether, then, the 
results of the questionnaire do not indicate much one way or the other 
concerning the lelfitivo mfiuencc of the motion picture and of oral 
instruction. 


Mbasubiss of Iktbbbst 

As measures of intoicst a record was kept of certain specific 
voluntary activities on the part of tho children This record included, 
first, a record of all the elippings or original articles, pictures, poems, 
stones, etc., which were contributed by the children, second, the 
number of booklets which weie read by the children of their own 
aoQoid, the amount of literature which was taken home and tlie 
number of acore cards concerning their reading which they voluntarily 
kept. The booklets, literature, and score rards weie placed on the 
desk where tho children could get them and they weie told that they 
were free to use them if they wahed to do so. 

A summaiy tabulation of tho contributions and voluntary acts is 
found m Table HI. A comparison of tho integral numbers in the table 
IS qualified somewhat by the difference in the total number of pupils 
in the two gioups. The number rcpiesented in the experimental 
group IS 20& and in the contiol group 182. Some of the chffeicnces, 
however, are of such magnitude that this qualification is of minor 
importance 

It will bo seen that the pupils of tho expeiimental group brought 
in a much larger number of articles and pictures and contiibuted a 
largci number of original articles, cartoons, and pictuies The pupils 
of the control group brought in a somewhat larger number of poems 
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and drew a somewhat larger number of posters The differences, 
however, aie iiot so laige as those in favoi of the experimental group. 
Taken as a whole, it is oleoi* that the pupils of the experimental gioup 


Tabuj in.—A Record op Certain Voluntary Activities CAniuBD on, Used 

AS A MBASURB or INTKIIBST 



Expcumental scliool 

(102 boys, 106 
girls, 208 total) 
No. 

Control achool 
(07 boys, 85 girls, 
182 total) 

No 

Contributions 

Clippings. 



Article 

53 

7 

Cartoon 

3 

5 

Cliart 

7 

1 

Magazine 

1 

3 

Model 

0 

1 

Pamphlet 

2 

0 

Picture 

410 

72 

Poem 

2 

29 

Poster 

0 

4 

Story 

2 

1 

Total 

480 

123 

Average per child 

2 31 

0 68 

Original 



Article 

16 

3 

Cartoon 

26 

4 

Chart 

1 

4 

Picture 

40 

9 

Poem 

10 

4 

Poster 

0 

14 

Story 

7 

1 

Total 

90 

39 

Average per olnld 

0 48 

0 21 

Grand Total 

579 

162 

Average per child 

2 78 

0 89 

Average booklets rend 

0 69 

0 66 

Average pieces of literature token home 

0 74 

0 82 

Average score cards filled out 

0 46 

0 3B 


contributed a much, laiger numbei of niticlos and of original inateimls 
of various sorts asieckoned in terms of the aveuige number of contiibu- 
tions per child In the number of booklets read, the literature taken 
home, and the score cards filled out, howevei, there is no significant 



418 


The Joui'nal of Educational Psychology 


difteience between the two gioups. The balance is slightly in favor 
of the experimental gioup and the influence of the film appears to be 
somewhat significant It is probably significant that the item m 
which the expeiimental group is most superior is in the number of 
pictures which were contributed. The sight of the motion picture 
apparently suggested to the childien that they find similar pictures 
and bung them to the class The lesults do not suggest a great differ¬ 
ence in general interest or motivation between the two gioups. 

Change in the Condition of the Teeth 

It was thought that a change in the condition of the teeth might 
be a moie objective measure of the care which was exercised by the 
children or their parents and might, theiefore, be the most objective 
measure of the effectiveness of instruction The two types of changes 
which seem to be most significant are the change in the number of 
carious teeth and the change in the number of teeth which have 
received dental care The reports of the dental examinations at the 
beginning and the end of the period of instruction were therefoio 
examined to obtain a comparative measuie of these two typos of 
changes in the experimental and the control groups. 

It IS necessary to confine the comparison to the permanent teeth 
There is a difference in practice among dentists in the treatment of 
deciduous teeth—some fill them, others do not. 

Again, some deciduous teeth disappear between the first and second 
examination and the number of carious teeth would, therefore, be 
deoieased without any effort on the part of the child or his parents. 

The first permanent molars, sometimes referred to as six-year 
molars, were selected for examination because these are the permanent 
teeth which have been in the mouth the longest time They, therefoi e, 
give the greatest opportunity for decay and for the exercise of dental 
care. 

In interpreting the condition of the teeth or the change in the condi¬ 
tion of the teeth it is necessary to take careful account of age The 
eruption of these molars themselves is highly correlated with age 
and the eiuplion. of the neighboring teeth, which have an influence 
upon decay, is also correlated with age For this reason it was neces¬ 
sary to equalize the groups in accordance with the distribution of 
ages, in the same manner as was done for intelligence and initial scoie 
in the tabulation of the results of the infoimation test Since the 
teeth of girls eiupt eaihei on the aveiage than those of boys, it is 
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necessary also to keep the results from the two aoxes separate in the 
tabulation 

The first tabulation of a change in the condition of the teeth 
is given in Table IV. This table shows tho iiiciciise or dccioiise in 
the number of carious tooth from tho first to tho second examination. 
The groups have been equalized with respect to chronological age, 
but obviously they have not been equalized with roapect to the condi¬ 
tion of the teeth at tho fiist examination In the experimental group 
there were 263 carious molars at Che first oxaniination whereas in the 
control group there were 318 This may indicate greater suscep- 


Table IV —CnANan in tub Nusibbu op CAmoua Fiubt Pbkmanbnt Molahs 

FROM THE Frn&T TO THE SECOND EXAMINATION At'TBU TUB GnOUPS IIaVB 
UUEN EqUAUZKD KOn Aob 



No. 

Avernge 

CA 

months 

1 First cxanunntion 

, Second 

1 examination 

! No. 
enriouB 
molais 

Avciago 

poi 

child 

, No 
canons 
j molftra 

Avernge 

per 

child 

ExpGrimonta.1 school. | 

■I 






Boya, 


138 37 

122 

1 42 

137 

1 69 

Girls 1 

■a 

136 64 

121 

1 49 

120 1 

1 66 

Boys and girls ' 

107 

137 04 

243 

1 46 

203 ’ 

1 67 

Control school 







Boys. 

86 

137 70 

168 

1 96 

167 

1 94 

Girls .... 

81 

135 66 1 

150 

1,86 1 

183 

1 64 

Boys and girls 

107 

130 08 

318 

1 00 

300 

1 80 


tibihty of the chilclien of the control group to caues or it may 
indicate that these children have had less care The average number 
of cauoua molars per child increased m the expciimental group 
and decreased in the contiol group. At first bight this may 
appear to indicate that tlio instruction was moic efTicicnt in the control 
group than in the experimental group. Account must be taken, 
however, of the difference in the condition of the teeth of the two 
groups at the beginning of the expoixment It is at least possible 
that the greatei increase in tho carious teeth of the childien in the 
experimental school is due to the fact that there was greater oppor¬ 
tunity for increase 







420 


The Journal of Educational Psychology 


In order to furnish a check on this possibility, the gioiips were 
equalized not only with respect to chronological age, but also with 
respect to the condition of the first permanent molars at the first 
examination In other words, the children weie selected in the two 
groups so as to provide an equal number of carious molars at first 
examination The compaiison is shown in Table V The difference 


Tadl^ V— CuANaB IN TEH NcMDiEi OP Cahious irinsT Pheuanent Moi^ns 
pnoM TUB FmsT to the Second Examination ai-tjeu tiid Geotjps Have 
Been Equalised pon Initial Condition op These Molars 



No. 

Average 

OA 

First (lamination 

Second examination 

No of first 
pcimancnt 
molara 

1 carious 

No 

C&lious 

per 

child 

No of fiiat 
permanent 
molais 
caiioua 

No 

cai lous 

per 

child 

Experimental school 







Boys 

47 

130 02 

92 

1 90 

79 ' 

1 68 

Girls 

45 

133.20 

95 

2 11 

86 

1 91 

Boys and girls 

92 

136 17 

187 

•2 03 

166^ 

1 79 

Control school 







Boys 

47 

138 94 

91 

1 94 

86 

1 81 

Gills 

45 

133,82 

95 

2 11 

86 

1 01 

Boys and girls 

92 

136 43 

18G 

■2 02 

171® 

1 87 


* Twenty-two molars carious at first cxaminatjon and in “perfect condition" 
at second examination, 

2 Fifteen molars carious at first examination and m “perfect condition" at 
second examination 

in the two gi oups is now I'eversed The number of carious teeth per 
child decreases m both groups and sUghtly moie for the experimental 
than for the control group Apparently the unfavorable showing 
of the experimental group m comparison to the contiol in the earlier 
table was due to a difference in the initial condition of the teeth 
The difference in favor of the experimental group in the equalized 
groups IS hardly great enough to have statistical significance, particu¬ 
larly as it IS all due to a difference in the case of the boys It may be 
that we should expect no difference. Even the best of caie could 
probably affect but little change m the period of the experiment and 
the difference due to a difference m the effectiveness of the instruction 
m the two groups might be so minute as to be imperceptible when 
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In order to furnish a check on this i>oss\bihty, the gioups were 
equalized not only with respect to chronological age, but also with 
respect to the condition of the first permanent molars at the first 
examination. In other words, the children weie selected m the two 
groups so as to provide an equal number of carious molars at first 
examination. The comparison is shown m Table V, The diffeience 


Table V— Ghai^QE in tiik Nombeh of CAnious First Permanent Molars 
FROM THE First to thh Second Examination AF'rnn the Groupb Have 
Been Equalized for Initial Condition op Titebb Molars 



'No 

Average 

CA 

Fust oxamniaiion 

Second evaminotiOR 

No. of fwat 
peimancnt 
molars 
carious 

No 

carioua 

per 

child 1 

1 No of &8t 
permanent 
molaie 
callous 

No 

canons 

1 per 

1 child 

Experimental soliool. 






Hi 

Boys 

47 

139.02 

92 

1 90 

79 

m 

Girls 

46 

1 133 20 

96 

2 11 

86 

■iti 

Boys and girU. 

Q2 

ISO 17 

187 1 

2 03 

166‘ 

1 70 

Control soliool. 







Boys 

47 

13S.04 

91 

1 94 

86 

1 81 

Girls . 

46 

133 82 

96 

2 11 

80 

1 91 

Boys and girls, . 

92 

136 43 

ISC 

2 02 

171* 

1 87 


^ Twonty-two molars caiioue at firet oxnminntion and in "perfect condition" 
at second examination. 

* Fifteen molars carious at first examination and in "perfect condition" at 
second oxaminntioR 

in the two groups is now reveised. The number of carious teeth per 
child decieases in both gioups and slightly more for the experimental 
than for the conliol group Apparently the unfavorable showing 
of the experimental group in compaiison to the control m the eailiei 
table was due to a difference in the initial condition of the teeth 
The difference m favor of the experimental group in the equalized 
gioups IS hardly great enough to have statistical significance, particu¬ 
larly as it is all due to a diffeience in the case of the boys It may be 
that we should expect no difference Even the best of care could 
probably affect but little change m the period of the experiment and 
the difference due to a diffeience m the effectiveness of the mstiuction 
in the two groups might be so minute as to be imperceptible when 






Table VI— NtJUBER or Fibst Permanent Molars Which Were in “Perfect Condition” at the First 
Examination and Which Were Carious Filled or Extracted at the Second Examination 
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menauted by ibc rather slow proeesB of denial decay. Substantial 
equality of the two groups in this respect, thciefore, is perhaps just 
what should be expected. 

A more delicate measure of the effect of instruction is the amount 
of denial care which was given the tooth which needed such care This 
was measuied by recording the number of tcoth which were in perfect 
condition at the beginning of the experiment and became carious diumg 
the experiment These teeth evidently presented now problems in 
dental care. To determine how effectively these problems were met, 
a record was fuither kept of the numbci of sucli teeth which were filled 


Taulb VII —SoMMABV OP NuMnDR OP Firbt Pbiimanbnt Molars Bbcominq 
Carioos DuniNQ THE ExpsRiMcNTAL Pjaiiioo WiiicH Wdrb Givisn Ddntal 

Caru 



Summary of first 
permanent molars 

Second examination 

Not carious 
first 

1 examination 

Carious 

PiUcd 

Ex¬ 

tracted 

Received 

dental 

care 

No 

Per 
cent i 

No 

Per 

' cent 

1 

No 

Pci 

cent 

No. 

Per 

cent 

! 

Experimental school 






1 




Boys , , 

96 

21 

22 1 

3 

3 2 

2 

2 1 


19 2 

Girls , ., , 

80 

16 

18 8 

0 

7 6 

8 

3 8 


37.6 

Boys and gills, 

176 

30 

20 0 

0 

6 1 

6 

2 9 

14 

28 0 

Gonti'ol school 










Boys. . , . 

73 

21 

28 8 

2 

2 7 

2 

2 7 

4 

16.0 

Gills. 

63 

17 

WMm: 

5 

7 9 

0 

EO 

5 

22 7 

Boys and giils , , 

J39 

38 

27 0 

7 

6 1 

2 

l 6 

9 

19 2 


or extracted during the period of the experiment This record is 
tabulated for each of the four six-year molars separately This 
tabulation is presented in Table VI. The individuals are selected fiom 
the groups which were equalized by Efcgc and approximately by average 
IQ. It may be lead as follows: Among the oighty-six boys who made 
up the equalized group in the experimental group there wore twenty- 
seven perfect teeth on the first examination On the second examina¬ 
tion it was found that there were six canous teeth, one filled and one 
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extracted. In other words, eight teeth had become carious and of 
these two had received dental care. Twenty-five per cent of the teeth 
which had become carious, therefore, had leceivcd dental care The 
significant figures, therefore, are the percentages undei the column, 
Received Dental Care. 

The mam facta of Table VI are summarized m Table VII It 
appeals, for example, that among the boys of the experimental gioup 
there were ninety-five six-year molars which were not carious at the 
first examination Of these, twenty-six became carious, and twenty- 
one of these twenty-six remamod carious at the second examination 
Thiee had been filled and two had been extracted. Of the teeth which 
had become carious, theiefoie, 19 2 pex cent had received dental care 
Among the boys m the control gi'oup, twenty-five teeth had become 
caiious, and of these, four had received dontal care, or 16 per coni. 
In the case of the girls of the experimental gioup, 37.5 per cent of the 
teeth which became carious leceivcd dental caie and of the giils in 
the control gioup 22.7 per cent of the tooth which had become caiious 
leceived dental caio. The per coni for boys and giils together in the 
case of the expeiimenial group is 28 and the control group 19 2. 
While the numbers arc small, tho evidence points in the direction of the 
conclusion that tho children of the experimental group received better 
dental caie than did those of the control group. In neither group, 
however, can the instruction be regarded as having been very effective, 
since fewer than 30 per cent of the teeth which required dental caie 
received it. 


Summary 

The experiment was cairied on in two fifth and two sixth grades of 
two public schools. Gioup 1 which saw the films was in one school and 
Group 2 which, did not see the films was in the second school. The 
purpose was to measure the effect of scemg the motion pictures on the 
children’s behavior. 

The procedure consisted in giving the same instruction for thirteen 
school days to tho parallel gioups The teaching was done by a 
trained assistant. Tho subjeefc-matter included instruetion on tho 
structuie and development of tho teeth, on diet, and the care of tho 
teeth. The same detailed oiithnc was followed with both gioups 
With Gioup 1 oral instruction was supplemented by pictures, diagiams, 
and models, and also by two motion piotuie films entitled. Tommy 
Tucker's Tooth and Clara Cleans Her Teeth With Gioup 2 tho 
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motion piofcuie film was not used. The number of children in Gioup 1 
was 208 and in Group 2, 182. 

The results of the instmction were measured by 

1 All mrormation test 

2 A quostiomiaiiQ m which the childion rcpoitcd on Ihc caro of tlieir teeth 
at homo and the food wluch they ate 

3 Material biought in by llio childicn 

4. Condition of the tcoth us determined by dental oxammntion 

1. InfoimaUon Test .—The groups were first equalized on the basis 
of intelligence teat scores Group 1 advanced fiom a score of 17.03 
points to 29 47 points while Gioup 2 advanced fiom 14 85 points to 
29 69 points. Gioup 1 thus advanced 12.44 points and Group 2, 
14.84 points or 2.4 points more The film gioup thus gamed less on the 
information test than the control group. 

2 Questlonna^re .—The childien of both groups leported almost 
universal use of the toothbiush and eaimg of vegetables, fiuit, and 
milk. Fewer children of Group 2 reported using the toothbrush daily 
(eighty-one per cent as compared with ninety-eight per cent). The 
difference seems hardly significant 

3. Material Brought In and Read —Group 2 read about the same 
number of booklets and took home more literature, but Group 1 
brought m many more clippings and contributed more oiiginal articles, 
cartoons, and pictmes. This eomparison is somewhat m favor of the 
film group 

4 Results of Denial Examinahon .—Since age is a factor in the 
development and decay of the teeth, the groups wore equalized by 
ages After such equalization the comparison ivas made of the 
average number of carious aix-year-old molars of the two groups on 
examinations made before and after instruction In Group 1 the 
average number pei child increased from 1.46 to 1.57 and in Group 2 
the average number decreased from 1 90 to 1 80 The difference may 
have been due to a difference in the number of carious teeth on the 
first examination The gi’oupa were then equalized on the basis of 
the condition of their six-ycar-old molars on the first examination 
In Group 1 after equalization the average number per child of caiious 
six-year-old molars decreased from 2.03 to 1 79, and in Gioup 2 the 
average number decreased from 2 02 to 1 87 This shows a slight 
advantage foi the film gioup 

A eomparison was then made of the molars which were in perfect 
condition on the first examination A smaller number of perfect 
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molars became carious in the case of Group 1 than in the case of Group 
2 , {20 6 per cent against 27.9 per cent) A laiger number of these 
teeth received dental care m Gioup 1 than in Group 2, (28.0 pei cent 
against 19 2 per cent) This comparison is slightly m favoi of Group 1 
The children who did not see tho film apparently gamed more 
information fiom the matiuction than those that did The childien 
who saw the filmj however, appeal to have been stimulated to some¬ 
what gieatcr activity m bunging in aupplcmciitaiy mateiial After 
careful analysis has been made of the data, the group which saw the 
film appears to have improved somewhat more in the condition of 
their teeth than tho pupils who did not see the film The difference, 
however, is not conclusive A slightly largei percentage of the group 
which saw tho film leccivcd dental care, but fowei than 70 per cent 
of the defects of oithcr group were corrected. Further expeiimenta- 
tion would be desirable with somewhat more carefully controlled 
conditions and with films which may be more effective than those 
which were used iii the cxpciiment 



INTELLIGENCE. MOTIVATION, AND ACHIEVEMENT 

AUSTIN H. TUKNBY 
XJnivoi'aity of Kansas 

Leading authorities in the field of psychology nnd of educational 
psychology recognize the existence of fundamental motivating mccha- 
maras. Thus Gates writes of cei’tain "cravings’' and "urges''^ and 
Woodworth of "dependable motives.”* These fundamental motives 
are factors in school achieveraent to a giealcr oi lesser degree, depend¬ 
ing m pait upon the method of teaching being used Thus we have 
many writers accepting the project method as psychologically sound 
because it enlists certain of these depesndable motives ^ The literature 
of method is full of discussions concerning "motivation” or "motivating 
the pupil.” 

The beginning student m educational psychology sometimes fails to 
appreciate the direct and practical connection between fundamental 
motives and actual schoolroom work. It has boon our expeiience that 
the importance of motivating mechtmismB is made moie clear if the 
treatment of this topic is hnked up with the discrepancy between 
intelligence and achievement. This approach not only emphasizes 
the importance of the r41e of motivation, but also recognizes the fact 
that one great educational problem is that of determining the extent 
to which motivating mechanisnis affect achievement, and of deteimin- 
ing the possibility of affectmg these mechanisms through teaching 
technique and choice of content, 

A number of investigators have submitted data indicating that 
the discrepancy between intelligence test lesults and achievement usu¬ 
ally found in schoolroom situations is not necessarily the result of 
faulty measures either of mtelligence or of achievement On the con¬ 
trary, this discrepancy is the natural result of other factors, chief 
among which are certain traits or types of behavior which foi want of 


1 Gates, A I “Psychology for Students of Education." The Macmillan 
Company, 1930, Chap VI 

2 Woodvvoith, K S "Psychology.'’ Iloniy Holt and Co , 1020, Chap VI 
^Joidan, A M “EdiicationolJPsychology " Henry Holt and Co , 1029, p 113. 

Kilpatuck, W. H. "Foundatioiia of Method." The Macmillan Company, 
1926. 

Douglass, n R “Modem Methods of High School TGachmg " Houghton 
Mifflin, 1928, Chap XI. 
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better tcims we may call “indusLiy/* “persistence,” “ambition,” 
"school attitude,” and “dependability.”* 

This paper will present data suggesting that the behavior of 
pupils clmiacterizcd by such Icims as “industry,” “perseverance,” 
“dependability,” and “ambition," as judged bytcachersigpiobablyan 
index of conditions of motivation, and indicating also the importance 
of the factors of motivation in school achievement. The data were 
secured m a study carried out in the Univcisily of himncsoln High 
School Eveiy student in each of the four classes in the liigh School 
was lated by each of hia teachers twice duitng tho school yeai on each of 
nine traits The reliability of the judgments, as found by coirclatmg 
first and second judgments made about sixty days apart, was, on the 
average, .80 

Intel correlations wcic caloulatcd for the following vaiiables “ 

1 Numericnl value of all marks earned by each student during his entiio 
residence in the high school 

2 Chronological ago 

3 IQ derived Xioin five 01 moio Icstfl 

4 Mental ngo 

6 Industry 

6i Peisovemnce 

7 Dependability 

8i Ambition 

Foi the Junior and Senior classes paitinl correlations of the first 
ordei weie calculated holding constant in turn CA, MA, IQ, and marks. 

Table I presents zero ordei coirelations concerning the Junior 


class. Attention is especially called to the following groups of coeffi¬ 
cients showing the correlations between certain variables: 

Marks and MA 

67 

MA and industry 

33 

Marks and IQ , 

61 

MA and perscveiance.,, 

36 

Marks and industiy 

80 

MA and depoiidnbihty 

37 

Marks and perBCveinnce 

. . 80 

MA and ambition, . 

40 

Marks and dependability 

82 

Industiy and pciseveiancc 

96 

Marks and ambition 

84 

Industiy and dependability . , 

96 

IQ and industiy 

37 

Industry and ambition 

93 

IQ and persovoranco 

48 

PoiseveiancG and dependability 

96 

IQ and dependability 

.40 

Pcisovoranco and ambition 

91 

IQ and ambition 

44 

Dependability and ambition ' 

93 


'See Tuinoy, 'A, ^II. “Factois Other than InLelhgenco That Aftect Success 
la tho High School as Indicated by TGaohois’ Marks " Minneapolis, Minn,, 
UmveTsity of Minnesota Pi ess, 1930, pp. 31tf foi n review of these studies 

^ The original data involve six other vaiinbles omitted ns not pei fcmeiit to this 
analysis, 



428 


The Journal of Educational Psychology 


Table I.—Intbrcorkblationb between Variables Indicated 
(N = Ofi Juniors, University of Mumcsoia High School, 1926-1927) 



1 

2 

3 

4 


6 

7 

3 






In- 

Poi- 

Do- 

Ambi¬ 

tion 


Marks 

GA 

IQ 

MA 

dus- 

sevei- 

pond- 






try 

aneo 

ability 

1, Mniks 


- 314 

008 

369 



822 

842 

2 CA, . . 



- 493 

- 419 


- 307 

- 118 

- 358 

8. IQ 




.952 

3Q5 

481 

397 

444 

4 MA 





320 

352 


398 

5 Industry 








928 

6 Persevernnce 



, 




950 

013 

7 Depenclnbility 

S, Ambition 



* 





934 


Table II presents similar data concerning the Senior class in which 


attention is invited to the following coirelations: 


Maiks and MA, 

67 

MA and industry 

35 

Marks and IQ 

. .60 

MA and porsevernnee 

31 

Marks and industry 

06 

MA and dependability 

41 

Marks and peisoveranco 

63 

MA and ambition 

89 

Marks and dopcndability 

. 72 

Industry and poraevei'anco 

.90 

Marks and ambition 

68 

Industry and dependability , 

90 

IQ and industry 

33 

Industry and ambition 

78 

IQ and pcrsevorance 

. .32 

Poisevoianco and dependability 

91 

IQ and dependability 

41 

Peracveraiico and ambition 

S3 

IQ and ambition 

.. .40 

Dependability and ambition 

82 

Table II— iN'TBiicounBiiA'pioNSDETwBisN Variables Indicated 
{N = 48 Semois, Univetsity of Minnesota High School, 1926-1927) 




1 

2 

3 

4 

5 

6 

7 

8 






In- 

Pei- 

De- 

Am¬ 

bition 


Marks 

CA 

IQ 

MA 

due- 

saver- 

pend- 





try 

anoo 

ability 

1 Marks . 


- 315 

601 

671 


630 

717 

676 

2 CA 



- 736 

-.712 

~ 266 



- 390 

3 IQ, 




.986 

330 

315 


399 

4 MA , 





848 

305 

406 

389 

& Industry 

6 Perseverance 

8. Dependability 

7 Ambition 

• 

■ 

• 

‘ • 


966 

896 

911 

780 

834 

815 
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For our purposes we may aummaiize the two tables as showing a 
correlation between marks and IQ slightly higher than the average 
coeflacient of correlation between measures of intelligence and measures 
of achievement reported m the litoratiiic.^ Between marks and the 
traits of "industry/’ “pcrseveiance,” “dependability” and "ambition,” 
the correlations are as high and, more often than not, higher than the 
correlation between IQ and marks or that between MA and marks 
The correlation between IQ and each of these four traits and between. 
MA and each of these four traits is relatively low, but the correlation 
between each pair of these four traits is high 


Tails III — iNTsnconRBi-ATioNS between Variables Indicated with CA 

Constant 

{N = 66 Juniors, UiiiveisUy of Minnesota High School, 1920-1927) 



1 

Marks 

2 

IQ 

3 

MA 1 

4 

In- 

du6- 

try 

6 

Pei- 

sover- 

ance 

6 

De¬ 

pend¬ 

ability 

7 

Am¬ 

bition 

1. Marks 


646 

608 

780 


831 ; 

823 

2, IQ 



.942 

311 , 


392 

330 

3, MA 




272 

258 

364 

203 

4 Indus tiy 





960 

958 

036 

S Perseverance 






908 

006 

6 Dependability 

■ 






003 

7 Ambition 

■ 

■ 







The relatively low conelalion between each of the traits and 
either IQ oi MA suggests that neither are these "intellectual” traits 
nor are the judgments the effect of halo Halo effect of marks upon 
judgments of the traits can scarcely be present since each of the judges 
furnished only one-twelfth of the Junior maiks and only one-sixteenth 
of the Senior marks. 

In Tables III and IV are the partial coefficients of correlation 
between the variables with CA constant. Of the coirelationa espe¬ 
cially pointed out above the greatest change is in the case of that 
between IQ and marks which la somewhat reduced In the mam, the 
correlations between IQ and marlcs, IQ and the four traits, marks and 
the four traits, and between the traits themselves are not greatly 
affected when CA is held constant. 


i Turney, A. II Op cil, Tabic I 
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Tables V and VI present the partial coefficients of correlations 
between each of the variables with IQ constant. It is to be noted that 
the conelations between marks and each of the four traits, ‘‘industry,” 


Table IV—iNTBiicoiinELATiONa between Yabtables Indioatdd with CA 

Constant 

(jV « 48 Seniora, University of Minnesota High School, 1020-1027) 



1 

Murks 

2 

IQ 

3 

MA 

4 

In¬ 

dus¬ 

try 

6 

Per¬ 

sever¬ 

ance 

6 

De¬ 

pend¬ 

ability 

7 

An- 

bition 

1. Marks. 


.721 



610 


633 

2. IQ. 

, * 

^ , 



252 

327 

181 

3 MA 





.010 


683 

4 Industry. 


, 

. 

. 

956 


766 

6 Toi'sovoranco 

.. 


• 


., 


837 

6. Depon-dability . 


. 



,, 

,, 

803 

7. Ambition 









^‘pcraevera-nce/’ “dependability" and “ambition," and also those 
between, the traits themselves are but slightly changed. 


Table V —iNTEnaounBLATiONS between Variables Indicated with IQ 

Constant 

(V =* 06 Junioia, Umvcisity of Minnesota High School, 1926-1927) 



1 

Maiks 

2 

CA 

3 

MA 

4 

In¬ 

dus¬ 

try 

5 

Per- 

sevei - 

ftllCC 

6 

De¬ 

pend¬ 

ability 

7 

Am¬ 

bition 

1 Marks .... 


- 020 

-.283 

783 

728 



2. CA ., . . ... 

, 


184 

wm 




3 MA . 


... 

• * 


- 387 



4 Industiy... 





064 


937 

6 PersevGiance 


« • 




944 

888 

6 Dependability , ,.. .. 







921 

7 Ambition , . . 














_ 



The results of holding constant MA are shown in Tables VII and 
VIII The correlations between marks and the traits, and between 
the four traits themselves ftie but slightly changed 
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’When mavka are held conataait, as shown in Tables IX and X, the 
correlations between the four traits, ^‘industry/' ^‘perseverance/' 


Table VI.—iNTBnconnBLATiONB between Vakiableb Indicated with IQ 

Constant 

{N *= 48 Seniors, Univoisity of Minnesota High School, 1920-1927) 



1 

MaikB 

1 

2 

1 

CA 

3 

MA j 

4 

In¬ 
dus- 1 
tiy 

6 

Pei- 

sever- 

anoo 

1 

De¬ 
pend- 1 
ability. 

7 

Am¬ 

bition. 

1 Mftiks 

■ 

308 


634 

,601 

001 

.602 

2 CA 




- 019 

047 

05?' 

- 160 

3 MA . . 1 



■I 

173' 

- 046 

031' 

- 031 

4 Industry 




1 

,953! 

884, 

.749 

6 Persovcianco . , 






906 

816 

6, Dependability 


. ^ 

■ 


. ^ 

, 

767 

7 Ambition 

■ 


■ 


1 




"dependabiUty" and “ambition, ” and both MA and IQ become very 
low and usually negative. The correlations between the traite them¬ 
selves are still high 


Table VII —iNTEnconanLATioNS between Variables Indicated with MA 

Constant 

(V — 65 Jvmiois, University of Minnesota High School, 1926--1927) 



1 

Mfvrlcs 

2 

CA 

3 

IQ 

4 

In- 

dU9- 

tiy 

5 

Por- 

sovor- 

ancG 

6 

De¬ 

pend¬ 

ability 

7 

Am¬ 

bition 

1. Marks .... 

m 

- 097 

267 

790 

777 

803 

818 

2 CA 



- 333 


- 188 

043 

- 229 

3 IQ. . . 




187 

600 

203 

227 

4, Industry . 



, 




922 

6 PersovcraiicG , 



, 



043 

001 

0, Dependability 







926 

7 Ambition, 

■ 








The foregoing data indicate that the four traits, “industry, ” “per¬ 
severance, " “dependability” and “ambition” fire more closely related to 
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achievenicnfc than is eiLhei IQ or MA, and that they are not closely 
related to either IQ or MAj but that they are so closely related to each 


Table VIII — iNTBncomiELATiONB between Vahiables Indicated with MA 

Constant 

(H = 48 Seniors, University of^Minncaotn High School, 1926-1027) 



1 

Maitcs 

2 

CA 

3 

IQ 

B 

5 

Per¬ 

sever¬ 

ance 



1 Marks . 

n 

623 

286 

614 



606 

2. GA 


, 

-.343 


022 


- 174 

3 IQ 




mm 



116 

4, Industry 






883 

761 

5 Perseverance 







821 

6 Dependability 







786 

7. Ambition 

■ 








other as to show marked overlapping ^ In view of the high reliability 
found for all of these data we con only conclude that the teachers were 
in fact actually judging accurately the behavior of their students in a 


Table IX —iNTBUCOBEELATiONS BETWEBN VaWACLEB INDICATED WITH MaRKS 

Constant 

(N = 66 Juniora, University of Minnesota High School, 1926-1927) 



1 

2 

3 

4 

6 

6 

7 





In- 

Per- 

Dc- 

Am¬ 

bition 


CA 

IQ 

MA 

dus- 

sever- 

pend- 




try 

ance 

ability 

1. CA 


- 401 


088 

- 098 

267 

- 182 

2. IQ 




- 262 

- 008 

_ 227 

_ 168 

3 MA 




.260 

- 207 

- 218 

- 181 

4 Industry 





008 

877 

784 

6. Persevernneo 

6 Dependability 

7, Ambition 


■ • 

■ ■ 



8^ 

739 

7n 


specific schoolioom situation where these traits represent the exbcnfc to 
which the students were motivated to confoim. to classroom requiie- 


^ Garrett, H E “Stntisttcsin Psychology and Education *’ Longmana, Green 
*StCo 1926, p 291 
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meats and to achieve m classroom activities. Hence these judgments 
represent largely the effects of motivation and they necessaiily overlap 
as already shown. This overlapping of the traits and the lack of 
correlation between these Uaits and cithei IQ; MA, or CA point to the 
conclusion that the motivation existing in this situation was in reality 
the effect of “drive” or ^'clopenclable motives” as affected by the 
situation. 

The significance and implication of those data are, we believe; 
rather great They should aoive to focus attention upon the leal 
nature of the disciepancy between “mtclhgoncc” and school achieve- 


Tadle X —iNTEnconuEi/ATEONs UETWCCN Variadles Inuicatbd with Mahks 

Gonrtamt 


{N = 48 Scniois, Uinvcisity of Minnesota High School, 1920-1927) 


1 CA 

2 IQ. 

3 MA 

4 Industry 

5. Pei&oveiauco 
G Dependability 
7 Ambition , 



ment. It seems clear that the two majoi factois in school achievement 
are intelhgenco on the one hand and “motivation” on the other. But 
motivation is not to be regarded as the pioduot entirely of tho immedi¬ 
ate situation. The presence of fundamental driving meehanisms, the 
play of interests developed long befoie, and tho varying effect of the 
immediate situation in the gchooboom aie probably all a part of what 
we call “motivation.” 

Our data serve only to emphasize the presence and impoitance of 
factors of motivation. It would be dosiiablo to know to what extent 
these factors aie the result of specific environmental situations such as 
the classioom. To what extent can the “dependable” motives be 
mfluonced by specific Rohoolrooin situations such as tho use of the 
project method or tho socialized iccilation? In other words to what 
extent can the industry and ambition of pupils be changed through 
educational influences? The vaiiabilily m responsiveness to specific 
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bLimuliiting sitUcations in the classroom may be an much a l)iologically 
fixed quality aa ‘hnlolligeiicc” is usually coiihidoicd to bo.i On the 
other hand, li may bo vastly more subject to educational (t e , environ- 
iiicntal) iiifluonccs 

If wc accept for puipoaos of discussion llio concept of g ns set forth 
by Spotviinan^ the situation can be prcsciitiHl in tlio following way 
Two sludenLa possessing equal ainounlH of g would not necessarily 
utilize it ecumlly in the same classroom activity Moreover, even 
objeetively measured, acliievcmont must involve a great deal more than 
g. Not all clnssioom activities would coriclale highly with measures 
of g.^ Many of them would depend ns much or inoic upon just these 
charncteiistics of the student which we label “industry,” or “per¬ 
severance” foi success. Hence the correlations shown between 
“industry,” “perseverance,” “dcpcndalijlity” and “ambition,” and 
marks, are piobably incnsuies of a true relationship To the extent 
that the classroom work involves activUics not largely dependent upon 
a pupihs g, or to the extent that aclivilics very largely involving g are 
not attended to in equal proportion by students approximately equally 
equipped, a teaclier’s marks eould not conelatc pcifectly with measures 
of mtelligcncc. 

These facts might well be borne in mmd m using mental tests. 
They do not minimize the utility of tcuta of “intelligence” but rather 
enhance their value. In ability gioupmg, for example, until the possi¬ 
bilities of motivation aie known, wamiistagico with Billctt,^ who is one 
of the few to point out the advisability of grouping on measures of men¬ 
tal ability alone. To include in the ciitcria for gioupmg measuics of 
past achicvcniciib coveis up the very important cffccta of motivation 
The possibilities of educational guidance, and the undeistanding of 
diflicuItiGS arc much greater with the use of the single cntei'ion If 
criteria such aa achiovement tests which measurn, m part, the effects of 
motivation are used, they should be utilized in a manner peimitting the 
teacher’s knowledge of their presence and weight. 

njn not iiJiawnro of the arguniPijls ogainal Ibis poncopt, ns in llic T\yenly- 
Rcvciith Yoaihook of the National Bocioly foi ilio Hludy of Education, Paifc I, 
but ace Jennings, II S “Tlio Biological Bnuia of Human Nature " New Yoik’ 
W. W Noiton, 1930, p. 24 

^Sprnrinfln, (J. “Tlio Abilities of Man ” The Macmillan Co , 1027. 

“Ibid,, Chap. XII. 

^ Billctt, 11 0 A Controlled lilxpoiJincnt to Detenmno tJio Advantages of 
Ilomogoneous Grouping Ohio State University, Ediicolional Research Bitllelm, 
Vol VII; Nos, 7, 8 and 9, April 4,18, May 2,1028 
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“OMISSION” AS A SPECmC DETERMINER IN 
THE TRUE-FALSE EXAMINATION 


C. C WEIDEMANN 


Teach 01 a College, Univeiaity of Nebraska 


Do students tend to omit items of the true-false examination that 
aie true moie often than they tend to omit items that aie false? In 
this study each item is either true oi false by published authoiity 
as the oiiterion 

The specific determiner'- is a word or phase which occurs in the 
external form of a test item and alters the inierTial constiiutiom of 
that test item so that the correct response is either more often true than 
false 01 more often false than true. The specific determine) in any given 
test item may be so controlled by the individual who constructs the 
true-false examination that the coriect response is approximately eithei 
as often t)'ue as false or as often/afse as true 

Wood^ differentiates between inieinal constitution and the external 
form of examination items He says. 

The essential charactei of a question, and consequently its “statistical behav- 
loi ” depends upon its content as well as its external form The content of a ques¬ 
tion 13 often veiy subtle; many of the “simplest" questions aic found on inapection 
to be compounds of many subtleties, It seena quite reasonable to suppose that 
within the limits of accepted forms of questions, the “inner” nature of a question 
18 moie important than its “outer" form; although as n matter of common sense, 
one may sny that the “outei" aspect exerts moie influence as wo go down the 
intellectual or educational ladder and leas as we ascend it 

Assume that the spectfic determiners of a true-false examination 
have been controlled, yet the variable of the tempeiament of the exam¬ 
inees IS still present. The tempeieiment of examinees may cause some 
to respond more often true th&n false and other to lespond more often 
false than true to the same teat item m a given tiue-false examination 
This variable of tempeiament of the examinee seems to be somewhat a 
specific determiner in relation to any given test item A study of this 
point needs to be made 


1 Wcidomann, C C . “How to Constiuot the Ti-uc-falso Examination ” Bui- 
eau of Publications, Tcacheis College, Columbia University, 1026, p 68 

^Wood, Bon D Studies m Achievement Tests Joumal of Educational 
Psychology, Vol XVII, Jamiaiy, February, 1920, pp 1-22, 126-130 
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So fai as an individiuil oxamince is concerned, no direct technique 
seems to ])0 availiiblo to eonliol the iciiipeininent of that examinee 
while responding to the ilenis in ti-uc-fnlso exammatioua whose 
specific (Ictei miners so far as eitenial foi7n aie conceiiied, have been 
controlled on the assumption tliat scoie equals right viiims wiong, 
In the case of lingo gioups of OMUiiinpes tempmamont might bo con¬ 
sidered to bo a chance fnctoi, compcnsatiug in such a way that the 
tendency for some examinocs lo loapond more often hue than false 
would be ohset by the tendency of othois to respond more often fake 
than true. This study aasuinea the factor of tempeiaincnt of the 
examinees to be a chance factor. 

Fiitz*- and a fow others have claimed that students lend to lespond 
to true-false items more times aa tiuc than as false The figuies arc 
Bixty-iwo per cent true and thirty-eight per cent false, with technical 
information quite unknown to tho atudcnls IIo repoits practically 
the same result with information which was studied by tlio students 
as a icgulai part of tho class work. 

Ruch® reports “a numbei of studies similar to that of Fritz” 
and gives fifty-two per cent maiked ns true and foity-cight per cent 
marked as false, In an unpublished study by B. D. Duiiell, and 
0. L Cushman, (data available thiough G. M. Iluch, University of 
Cahrornia) “tho results indicate that puio guessing, when it occurs, is 
roughly a 60:60 situation.’' 

Rutledge^ found “that when the *aaine* items were stated in both 
true and false forms, they wore equally difficult ” 

These three studies make no mention of the “omission" as a specific 
dctoiminer 

In the fall of 1926 m a course entitled “Foundations of Modern 
Education," the writer used seven liue-folse examination tests based 
upon F. P Graves’s, “A Student's Hisioiy of Education " At the 
beginning of tho semcstci, the class totalled three hundred thirty-eight 
divided into three sections of nmty-mnc, one hundred three, and one 
hundred thirty-six students respectively. A total of three hundred 


1 Fritz, M F GuoHsing in a Tnio-fiilHc> TohI. Jomnnl of Educalional Psy¬ 
chology, 'Vol XVni, 1027, pp. 

^ Huch, G. M “Tlio Ob]«“olivo or Now-typn ICvamiiialion ” Scott, Foiciintin 
and Company, Now Yoik, 1020, ])p. SOB 

® Rutledge, R E “Tho Tiuc-fnlso I'Xami'nation in Elemontaiy Pftychology, 
with Suggcstiong for Its Impiovcment ” Uiipubliabcd Ph.D Tbcaia, University 
of California, 1027 
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thiity-one students included in this study lemained throughout the 
semester, The members in each section were given a reading assign¬ 
ment fiom Graves and within two weeks were given a true-false test 
based upon the reading assignment The object was primarily to 
measure immediate retention rather than delayed retention. No 
test contained any items which aimed to review material covered in 
any previously given test 

In oidei to reduce cheating to a minimum each of the seven 
bi-weekly tests was administered in eithei Forms A, B and C or 
Forms A and B. The students seated in Columns 1, 2, 3 had Forms 
B and C lespectively; Columns 4,5 and 6 had Forms A, B and C respec¬ 
tively, and so on After the foims weie answered they were collected 
by the instiuctor Then Columns 1, 2 and 3 had Foims B, C, and A 
respectively, Columns 4, 5 and 6 had Foims B, C and A respectively, 
and so on. Aftei the second order of Foims weie answeied they weie 
collected by the instiuctor. Then Columns 1, 2, and 3 had Forms C, 
A and B respectively, and Columns 4, 6, 6 had Foims C, A, and B 
respectively, and so on A similai* procedure was followed when the 
bi-weekly test consisted of Foims A and B. The total test time of each 
bi-wcekly test was fiom twenty-five to forty minutes 

The fiequency with which each item of each Form of a given 
bi-weekly test was omitted was tabulated for each student taking 
each test All results are lepoited upon the basis that the number 
of true items equals the number of false items m each of the seven 
bi-weekly tests The specific detenniners of '‘all and never,” “moie 
than, less than,” etc, and “If . then” weie controlled on the 
assumption that the scote equals lights minus wwngs 

The directions commanded the student to mark with a plus (-f-) 
only those statements which were entuely ti ue, if the statement were 
partly or entuely false it was marked with a zero (0). A response 
space was provided to the left of each statement The students were 
told not to guess 

Table I displays the nurabci of times each omitted item was either 
tiue or false A grand total of 3064 students lesponded to a giand 
total of 495 tiuc-falsc statements, accumulating a giand total of 3964 
omissions, in seven bi-weekly tests admimstcicd during one semester 
Table I shows that forty-four pei cent of the omitted statements 
weie true and fifty-six pei cent of the omitted statements wqiq false 
Is the twelve per cent di£fcieii-*e significant? The critical latio value 
IS sixteen, so that the diffeience is significant 
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Tabl'd I—Ndmbbu op Timrb Onnllcd Itkms Ann Eitiibu True oil False ton 
Each op tiid Seven Thue-false Tehtb 


Bi-wcekly 

tniG-falso 

Tho munhoi of tinips test iIlmuh woio 
omitlpcl by the sludeiit, winch items woi e 

Total omissions 

test mnnlmr 

Tiur 


1 

1 

2 

i 

4 

1 

i 737 

1 0.66 ' 

1392 

2 


1 283 

.^63 

3 

ir)9 


569 

4 

219 


422 

G 

67 



6 

112 

220 

341 

7 

172 

1 

412 

684 

Totals 

1720 ' 

2228 

1 3064 

For cent 

44 

1 60 

1 100 


ISven though tho atatmtical per cent <hneicncc is significfint, tiicio 
IS relatively little value in the per cent dilteiciico so far as affecting 
the score and placomont of an individual student is eonccinod 

Assumo; 

1 The 8COIC equal to tho total nmnhei of ifoins minus tho omifisiona minu'j two 

times the wiongs, i.c, 5 - 2’ — 0 — 21K. 

2 Tliat on tho average not moie than twenty items out of ovpiy oue-luuulietl 

items of Cl tuie-Ialhc ovuminntion would bo onuttod by a given student 
Some may omit moio and othcis less items. 

3 2’hat every item so omittccf would tJieti bo mailcccl false 

Then upon the basis of this study, fifty-six out of every one hundred 
omitted items arbitrniily maikcd false would be iiyhl and foity-four 
would be wrong. = 56 — 44 = 12 But, it is assumed that on the 
average, not more than twenty items out of every one bundled items of 
a true-false examination would be omiUed and arbiimrily inaiked 
fal^e. Thus the contribution of the omzmon 12 X 20 i?cr cent or 
2.4 points of score. This change of score seems administratively to be 
relatively insignificant in the degi'cc to which it may aifoct the place¬ 
ment of oil individual m a gi’oup 

1. Thrho hundred thii ty-one students who took the seven bi-weekly 
true-false tCiSts based upon Graves^ '’A Student’s Histoiy of Educa- 
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lion,” in ciudc per conls omitted items that were false more often that 
they omitted items that weio true. 

2. The ormssion m the seven bi-woekly true-false examinations of 
this study is a statistically significant specific determine). 'Hie ci itical 
ratio value is 10 

3. It Bcvuis to the writer that iii a very carefully constructed tvvie- 
falso examination “nmissions" aio piolmbly ns often iiuc as false, 
and as often fake as it no 

4. From the standpoint of affecting the giado placement of an 
individual student in a group, tins study would tend to indicate that 
the ommion as a specific determiner is not significant 

5 Further study will piobably show the omission of the truc-falso 
examination to lie statistically insignificant. 



FACTORS INVOLVED IN Cim.DREN’S FRIENDSHIPS^ 

GLADYS GARDNER JENKINS 
Vnivnaity of Chicngo 

The following study wns made m the effort to cliscovor definite 
facloia which influence the foiming of friondnliips anioiiff cliiJdrcii, 
There are, of course, many factois of a peiHoiml natuie not yet posisiblc 
of analysis, but tlioro are others sucli as tlie icliilive intelligence of 
child nnd fiicnd, age differences, play interests, and like factors which 
are measurable iii some dcgiee and may licar upon the question 
The study included two hundred eighty boya and giila representing a 
cross section of the junior high schools of Riverside, California, a 
city of appioximately 35,000 inhabitants. 

ClIUONOLOGICAL ACIK 

The chronological ago of one hundi od (*ig!ity children was compared 
with that of thoir friends. TJio range for one luindred twenty-five 
girls was twelve ycais and five months to sixteen years and eleven 
months; for their friends twelve years to mnotcon yoais and eight 
months. For fifty-five boys the ago range was twelve years and three 
months to sixteen years and four months; for ihoir fiiond.s Iwolvo 
years and five months to seventeen yoais The mean chi onological 
ago for the children was fourteen years and three months and for their 
friends fourteen years and five months, with a standaul deviation 
of 10.6 mouths foi the children, and 13 0 months for their friends. 

Of the one hundred eighty boys and girlssluchod mnoty-seven made 
their friendships in school, eighly-tlircc outside of hcIiooI. The mean 
chronological ago for those friendships made in school was fourteen 
years and four months for both tho children and their fiiends, with a 
standard deviation of 10.3 months for the ehildion and eleven months 
for their friends. The mean chronological age for the eighty-three 
friendships made outside of school was foui teen ycais and two months 
for the children and fouilccn ycais and six months for then friends, 
with a standard deviation of 10,9 months for the childicn and 16 1 
months for their fnends. As there is a larger spread in the chronoJogi- 

* Tlio ivritcv wishes to expicss hci mdebtedno^s to tho guidaiico of Dr Fiank 
N. Freeman in tins study, tmd to former Siipciintoiulcnt A N Wiicpiocic and 
Principal F P Taylor of tho Rivcrsido School System for llicir ooopciatjon m 
making available tholi iccords 


440 



Factors in Children*^ Fnendshij) 


441 


cal age range for those fnoncls which are made outside of school 
than foi those made within the school, it would seem as if the school 
has a tendency to diminish the age diffeience in children’s fiiciidships. 
In spite of the larger standaiU deviation for the friendships made 
outside of school there is no uniform or pciccpLiblo tendency for chil¬ 
dren to choose friends either older or youngci than themselves The 
data aie presented in Table I. 


Table I— Compahison of CnnONonooicAij Aon Diefbuence between Citild 
AND FniEND WITH THE PLACE WHERE TllEY MeT 


Age diffcionco. months 

Ncigliboihood and pltiocs 
other than school 

School 


1 

Per cent 


Pei cent 

Within one month 

0 

9 6 

mm 

4 S 

Ito 6 

22 

31 0 


38 8 

7 to 12 

17 

24 7 

40 

44 7 

13 to 18 

12 

17 6 

0 

5 9 

19 to 21 

4 

5 8 

3 

2 9 

25 to 30 

4 

5 8 

3 

2 9 

31 to 30 

1 

1 4 



37 to 12 : 

2 

2 9 



43 to 48 





49 to 54 





56 to 00 

1 

1 4 




The Pcaison piodiiet-inomoiit correlation coeflicient was +.470 
± .039 The coriclntion coeflicient for the ninety-seven fnendships 
made within the school was +.529 ± .019, foi the oighty-three friend¬ 
ships made outside of school, +.462 + .073 It would therofoic seem 
that the tendency for cliildrcii to choose friends of their own iigc exists 
independently of school giouping although it may l)c increased by it 

Intklligrnck Quotients 

Intelligence quotients obtained by tlic Torman Gioup tests within 
the two previous years weie available fiom Llie school rocoids foi one 
bundled ninety-.soven of the children, one hundied Lhirty-foiu giils and 
sixty-thrce boys 'Pho eonehvtion coefliciont was +.332 ± .043 as 
against a con elation coeflicient of + 470 ± .039 foi the cliionologioal 
age. The correlation cooflioieiit for the intelligence quotients of one 
hundred eight fricndshiijs made within the school was -1- 299 ± 069, 
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for eighty-iime friendships made outside of the school tho conelaUon 
coefficient was +.374 ± .062. Inasmuch as Lho con elation coefficient 
for the friendships made out of school is slightly higlioi than that for 
those made m school, oven allowing for the equalization which might 
ocour because of the probable error, the indications would seem to be 
that intelligence quotient is an independent factor in children’s 
friendships, not simply the outcome of scliool Hoetioiiing. 

The menu mtolligonco quotient for both the childicn and their 
fiicnds was 109 8 with a standard deviation for both gioups of 15.3 
For those friendships made in school the mean intelligence quotient 
IS 109 5 for the children, 1111 foi their fiiende, with n standard 
deviation of 14.1 for the childicn and 14 8 for their fiicnda, For 
those friendships made outside of scliool the mean iiitclligencc quotient 
is 110 1 for the children, 108 2 for their friends, with a standard 
deviation of 16 7 for the children and 15.7 for their friends. 

Mental Age 

The mental ago of one hundred seventy-two childicn and their 
fiiends, of which one hundred twenty were ghls, iifty-two boys, was 
computed for the tune of the study rather than for the time at which 
the friendship was made, as it did not bccin possible to secure an 
accurate record of the exact time when each fiicndslnp was foimcd. 
Inaismuch as all the childion studied had boon tested by the Toiman 
Group tost within the two previous years it was felt for the purpose 
of this study it would bo satisfactory to assume that the intelligence 
quotients had remained constant and to compute the menial age fiom 
the intelligencG quotient and the chronological age at the tune of the 
study. 

The mental age range for both the childien and their friends 
was eleven years and one month to twenty-one years eleven months. 
Seven children had the same mental ago as their friends, thn by-seven 
children chose fiiends with a mental age within six months of their own, 
sixty-two had a mental ago more than six months higher than then 
friends, sixty-six more than six months lowci There Bcem.s to be an 
equal tendency for a child to choose a fiicnd with a higher mental age 
as there is for him to choose a fiiend with a lower one. The mean 
mental age for the children was fifteen years and seven months with 
a standard deviation of 22 7 months, the mean mental age for then 
friends was approximately lho same, fifteen years and ten months with 
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a standaul deviation of 219 months. The correlation coefficient 
was 4" 423 i .042. 

A conipaiKson of the coiielation coeflicionts for chionological 
age, mental age, and intelligence quotient reveals the following data 
in order of the probable importance. 


Taulb II —A CIoMi'AiiiHON OF* Tiio CoimnnATiON Coni' fioiunth or CA, RIA and 

IQ 


1 

Siii)jw;t 

Con elation 
coefficient 

PE 

Chionological age 

-j- 470 

± 030 

Mental age 

H- 423 

± 042 

Intolligcncp quotient 

+ 332 

i 043 


School Divisions 

The fact that children seem to tend toward a choice of fricnda 
of approximaloly the same chronological age and mental age would 
suggest that these friends might also tend to be in the same grade 
or section in school. The following facts bear out this supposition. 
Of two hiiiulied fifty-foui cliildien studied (one Imndred twelve boys, 
one lumdiod flfty-ono gula) one hundred tliuteoii of their fnciuls weie 
m the same ficction, sixty-two m the same grade but not the same 
section, seventy-nine in other grades. Of the one bundled twelve 
boys twenty-three or twenty pci cent chose friends in a higher grade, 
twenty-one or eighteen pci cent in a lower grade, and seventy or 
sixty-one per cent in the same grade. Of the one huiidied fifty-ono 
girls eight or five poi cont chose friends in a lowci grade, thirty-two 
or twenty-one per cent in a highei grade, one bundled eleven or 
soventy-four per cent in the same grade The boys seem to have a 
higher range of fiiendships than the girls, si\ly-onc pei cont of the 
friends of the boys were in the same grade as against sevcnty-foni 
per cent of the girls This tendency, if it holds tiuc with n larger 
group, may be duo to Ihc fact that there is a slight tendency for boys 
to malm more friendships in the neighborhood and thiough clubs than 
girls and, as has biien shown, the age riiiigo for fiiendships made outside 
of scliool tends to bo slightly higher Chau foi .school-fiiondships. 

Pi/ACKR IN Which tiik TiiiKNnsini’K DKvnLoi'Ei) 

In ordei to discover whether the scliool, the neighboihood, the 
club, or oilier enviroiiiriental factors have the most efteet upon the 
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marking of friendships the following factors eoiiccining the places 
where the fiienclships woic made were investigated. 

1 School 

2. Neighboihood 

3. Club—Girl ScoiilH, Boy ScoutSj Y M. C A , Girl Keserves 
4 Church. 

5. Miscellaneous—family contncls, spocial Intel ests—mu.sic, etc 
Information was obtained from two lumilied fifty-five childien 
(one himdicd sixty girls, mnety-five boys). Table III indicates the 
number of fiiendshipa made in each of these places 

Tahlr III —NuMUp.n of Fkibnusiiipb in IIhlatjon to tiii: Pi.aoh Wiicnn tub 

CiiiLoiiBN Mnr 


Plncc ‘ 

Number of fiicnde 

Per cent 

Scliool 

138 

64 

Neighborhood 

03 

25 

Gluircli 

20 

8 

Club 

8 

3 

MiscollancoiiB 

20 

10 


The tabic shows that the school was the place in which the largest 
number of friendships was made, with the neighborhood ranking 
second. A slight tendency was found for the lioys to make more of 
their friendships in the neighborhood and places other tlian school 
than for the girls to do so. Forty-nine per cent of the boys and 
forty-four per cent of the girls made their fuendships in places other 
than school 

Tabic IV indicates that the section grouping has a distinct influ¬ 
ence upon the friendships which children make within the school, 
whereas for those friendships made out of the school the section has 
very little significance 


Table IV—Relation op Section Grodpinq to Puidndsuips Made in the 
School and Odt op the School 



Friondsiup nnido 

Fiiondship made 

School division of friend 

, m school, per 

out of school, 


cent 

per cent 

Same section . . ... 

04 

10 

Samo grade (not sarao section) 

26 

21 

OthOT grade 

11 

67 
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Occupation op Parent 

Ill OTtlci to attempt to detevmmc the influcnco of the sooial-oco- 
nomic status of families upon the fiiendslups of the children a compari¬ 
son was made between the occupation of the father of each child witli 
that of the father of his friend Por Uic purpose of the study the 
occupations were grouped into the following four groups, coinciding 
appioximatoly with tlio social groupings of the community; 

1 Unskilled and scmi-Bkillcd labor 

2. Slalled labor (carpenter, electrician, etc). 

3 Semi-professional (nurse, school tcachei, etc.), commercial, 
owner of small rancli or citi'us grove, clciical. 

4. Professional (engincci, physician, etc), business executive, 
owner of laige ranch or citrus grove. 

Two hundred thirty-seven cases were studied (ninety-five boys, 
one hundred foity-two girls). It must bo lemcmbercd that Cahfoinia 
is a largo middle class state, and tlierofoic Die total distribution of 
ohildron is largely weighted toward the skilled labor and commoiolal 
groups. Table V indicates the rosiiUs secured 


TaHLH V —CoMl'AIUHON OF OCCUPATION OP PAllENT OP CUlLP WITH PaKENT 

OP FuibNJ> 


I’ltronl'fl ocaiipnlluii 

Unskilled 

Skilled, oto 

Conimcroinl, 

oto 

Professlonnl, 

oto 

Total number 

Per cont ni 

Ntim* 

I’or 

Ntini- 

Ter 

Num- 

Per 

Niim- 

Per 

q( qcisco 

total nutaber 

bot 

oent 

l)cr 

cont 

boc 

cont 

bcc 

oont 

Unakillcd labor 



n 






16 

7 

11 

00 


25 


0 



Skilled labor, oto 









121 

51 

•1 

3 


00 

20 

24 

5 

1 

Commoroinl, oto 









71 

1 




10 

50 

71 

0 

13 

rrofeaBionnl, etc 









30 

13 



B 

3 

7 

23 

22 

71 


These figuu'B would bimmii lo mdiciito that the aoeml-cconomic 
status of the piuenLs in Hio coinimiiuty is an impoi taut onleriou lu the 
choice of fneiuLs winch Die child makes, In eacli case the number 
of friends chosen from the same social-economic gioup equals more 
than sixty per cent of the total diatvihutioii’ 
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Pkw Cent 


XJnftkillod lahoj 09 

SUillcd labor, clu 09 

Cominoicial, otc 71 

Professional, etc 74 


The coiTcIaiion coefficient +.716 ± .032 strongly expresses this 
tendency for childioii to choose fiicnds of the flame social-economic 
gioup As thcie were only four giuups the correlation coefficient 
was corrected for coarse grouping hy Shcpheid’s foimula with a 
resulting correlation coefficient of +.817 The conelation coefficients 
for the boys and thoir frionds and for the girla and tJicir fnencls were 
practically the same, +.695 ± 030 for the boy group, and +.724 + 
.027 for the girl group. 

It seems probable that the Bignificancc of the high correlation 
coofiicioiit IS not greatly influenced by tlio pioximity of the homes 
of the oluldrcn and their friends, as only twenty-five per cent of the 
ohildroii stated tluit tlioir friendships had been formed in the ncighboi- 
hood. It might also be mentioned that the clubs and ohmehes m 
lliversido arc centralized lathcr than located in special residential 
diatiicts, so that it is probable that those friendships made through 
these agencies were not unduly influenced by ncighboihood divisions. 
There is also a suggestion of a tendency for children to icaoh into a 
higliei sooial-oconomio group m the choice of a friend, forty-eight 
children chose friends in a higher group against twenty-bhico who 
chose them in a lower one. 'I'ho facts given show, however, that the 
stronger tendency in a child’s choice of a friend is toward those of tho 
same social-economic level. 

Play Interests 

Lehman's Flay Quiz was given to one hundred twenfcy-six children 
(twenty-eight boys, nuiety-cight girls) and their fiiciida. Unfortu¬ 
nately the teat was given one week after the othci data had been 
collcoted, and m the meantime a reairangomeut of school groups 
had made it iinpossiblc to reach all the boys who had been studied 
at the original time. The numbci of boy.s, Iherofore, is loo small to 
permit any definite statement concerning the findings init tho (rends 
will be of inteicst In scoring the testa the number of activities 
carried on in the past week because tho child liked to do thorn wcio 
checked against those of his friend, and the number of identical inter- 
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ost 3 iccorded. The child's mteiesls were then clipcked agninsL 
those of cases picked nt landom from the childion studied, three 
cases for each of the gnls, six for each of the boys. The menu number 
of like intorcsLs foi child and fiicnd, and child and other than fiicnd 
18 shown in Table VI It would seem iia if there were a slight tendency 
foi the childvon and Iheii friends to have tho laiger number of common 
interests. 


TaDI-B Vf — MbAN NOMflDU OP LiKIJ iNTBItBfaTH POlt ClIIM) AND FltlBND, ANU 
CinW) AND OtIIDU than FniEND 


ClIII.DnEN 


lioya 

Boy and Fiicnd 
Boy and othci tlian fueiul 
Gills 

Girl and Fiicnd 
Gill and oLhci tliaii/uend 
Boya and Gnls. 

Child and friend 

Child niul othci thun fiicnd 


Mean NiiMnsn of 
niKR IllTGn£»Ta 


18 5 
10 

10 5 
l‘J 6 

17 

16 


A study was next matlo of Section D of the tost m order to diacovei 
whether the child and best friend tend to have piininry inteie&is in 
common. Table YII shows that inoio children Imd a common interest 
in one of the three thiiiRS they like to do beat with then friend than 
with the childicn picked at inndom from the gioup. Twenty-seven 
per cent of tho childicn btiuhod had one of their three greatest interests 
in common with thoir best friend ns compared with nineteen pei cent 
who had one of then* gicatest intcicbla in common with children 
selected at landom. 


Table YII. —A CoMi'AmsoN op Common PaiMAm iNTBiiBBTa between Cjiild 
AND FllinNIi, AND ClIILI) AND OtIIBU THAN FlUEND 


Numliei of piimaiy 
intPicsts 

Pci cent of coinnion 
piimniy iiiluicsts between 
cliihl and fiicnd 

Pci cent of common 
intciests between child 
iiiid otlici tlian fiioiul 

1 

27 

lU 

2 

r, 

1 

3 

1 
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Bummahy Olf CONULimiONh 

Social-econonm tHtatus of Parents —Of the factorfl confeidcrod in this 
study pi'iinaiy importance is assigned to the Bocial-econoiiuc status 
of tlic paronts. The correlation ooefficiecit for tlic Hocial'cconomic 
position of parent of cluid and piiieiit of fimiid was ^-.7]C ± 032 
CoriGotcd for coarse grouping hy Hhephei'd’s formula the coefTicicnt 
was -[-.817. This lugh coirelatioii docs not seem to have been .signif- 
icantly influeiicod by the pioxiiniby of homes as only twenty-five per 
cent of the total mimhcr of cluklicn .statcil that they iiiade their 
friends in the iioighborhood Yhcix} was also a 6ugge.stion of a tendency 
for the children to choose fiiciids of a higher social-economic group; 
forty-eight had fiionds in a higher gioup, fcwenty-tliicc m a iowei. 

ChionologiCLil id pc.—The coiielation coeflicieiit foi chioiiological age 
was -I-.470 ± .030. Tins ib prohahly somewhat greater m those 
friendships made in school Childien lend to choose friends withm 
one year of their age. There is no tciidciioy to choose friends either 
older or younger. Fnenclships made in the neighboihood have a 
larger ago range than fnendships made in flchool. 

Menial Age and Intelligence Qualtenl —The coiTclation coefTicicnt 
for mental ago was d-.d23 ± 042. "I’ho corielatioii coefTicient for 
intoUigenco quotient was 4.332 ± 043 The fact that thciiiLclhgcncc 
quotient correlation coeffioient does not sec*m to bo influenced by 
school groupings would suggest a spontaneous tendency to choose 
friends of the same appioxunato intolligencc 

School Divisions and Place of Meeting —There is an almo.st equal 
division in the number of friendships inadc in the school and those made 
in the neighborhood or tliiougli homo contacts, cJiiirchcs, and clubs 
It must bo lecognized, however, that the Bchool is the greatest single 
source with the neighborhood ranking second with twenty-five poi cent 
of the total number of fncndslnps. Of those friendyhips made in 
school the giadc-section divisions seem to be of importance. 

Play Inleresls —According to the data secured fjom Lehmanns 
Play Quia there seems to be a slight tendency for childien to have a 
greater number of like interests with their best friends than with other 
children. It can not be stated ns to whether tins common intoiost was 
the cause or outcome of the friendship. 



A STUDY OF CLASSROOM BEHAVIOR 

WILLARD C OLSON 
Univoreiby of Michigan 

Considerable inloresL has been shown in recent years in the develop¬ 
ment of tcchniqnefl for the quantitative expio&sion of personality traits 
not easily amciiablo to inciisurcmcni by test methods By the use of 
carefully dofiued categories of overt behavior, relatively shorL time 
samples, repeated observations, and S 5 ^tematic recording, the writer 
has attempted to accomplish the task of measurement through direct 
observation^ The adaptability of the gcneial method to a variety 
of behavior traits has been illustiated by Goodeiiough.^ The present 
investigation was initiated to test furfcliei* the applicability of the 
method and to acquaint a class in the psychology of personality with 
its use. 

Whispering was choacn as the behavior to bo observed. Wickman^ 
has shown that whispeung ranks first m frequency of occurrence 
among behavior probleina in children, although tenclicrs do not regard 
its occuii'cnce in a child as a serious behnvioi disorder A behavior 
pioblem IS defined fiequently ns a diacicpancy between the environ¬ 
mental demands made on an individual and his adjustment to them 
Whispering, according to this definition, may or may not be a behavior 
problem in a particular classroom depending upon the requirements 
made with respect to it The piesont report is concerned with an 
attempt to mensuro and describe whispciing behavior m schoolroom 
sitnationg quite apart from any judgment concerning its dcsiralnlity 
or undesirability. 


Collection op Data 

Ariangcmcnts were made to peimit the class to spend one hour, 
from 9:00 to 10.00 A M , in obscivation in an clementaiy school' 

Olson, AVilkid C "Tho MonBuroniPiit of Neivoiis Ilnbits m Noimnl Cliil- 
dren '' Minneapolis The University of MiimesoUi Piets, 1020 

2 GoodenoiiRli, Florence L Monsuiiiig Bolmvioi Tuuts by Means of Repeated 
Short Samples Journal of Jmemle ltesMreh,Vo\ XII, 1928, ])p 230-235. 

*Wielcnmn, K K “Ohildion’H Ucliavioi and Toiiehms’ AttiUideSs " New 
Yoik The Commonwealth Pniid Divinioii of Piiblieiilions, 1028 

* Tlio writpi iH indebted to Mias Kallieiino (1 Youni?, Piineipal of tlic Mnicy 
School, MiimeapoliB, foi coopciiitioii ui this piojcot 
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Each obspi’vpr was supplipd with a mirarographcd shoot of instructions 
giving explicit diipctions for making tlie obHcrvations '■ A whisper 
for the puiposG of the study was defined ns an unauthorized oral 
communication—whispered or aloud—to a person oi persons other 
than the teacher The unit of mcasiuemoni was dofined ns one 
or more acts of wlnspermg per fivc-minutc period. Two observers 
wcic stationed m each room at opposite Hides and all rooms in the 
building studied at the same liour. One Btudont substituted a series 
of obspivaiions made on a twelfth grade class in economics. Ton 
successive observations wcic made and recorded in a pi csci ibcd manner 
on seating clmits of the rooms The total number of tunc samples 
in which a child was recorded ns whispering was called his whisper 
score. 

Reliability op 'WuiRPBn Scoubs 

The loliabihty of the total scoic for ten five-miniito records was 
obtained by correlating the values obtained on each child by the two 
observers in each room The coefficient of coiTckitioii between the 
two sets of scoies varied botwccH 20 and .78. The predicted relia¬ 
bilities (Spcarman-Biown formula) for twenty five-minule periods 
varied between 33 and 88 for the grade gioups studied (Table I) 
The reliability of the single observer of a high school class was studied 
by correlating the sum of the odd numbeicd observations with the sum 
of the even numbered observations. The reliability cocflicient for 
five observations was found to bo .67 with .80 the predicted value foi 
the ten observations. 

In the room where the lowest reliability coeffioieut was found, 
the method of leaching called for frequent shifts in the seating ai range- 
ment Since the observers did not know the children except ns a seat 
location, such changes introduced difficulties. A gieater amount of 
time would have to bo spent in such a situation, the room program 
alightly modified, oi the children identified as individuals, to secure 
the requisite reliability It is probable that some initial tiaimng 
m the use of the method would impiovc the accuracy of the observers 
Increased reliability would be obtained by making a larger number of 
observations 

It was foil that the records obtained showed siiflicicnt consistency 
to warrant further inquiry into their distribution and sigmlicance 
In the subsequent analysis, the average of the records of two observers 

> Copies of the inatiuction sheet may be obtained from tho wi itor upon Tcquost. 
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was taken as the score for eacli cliilcl in the elementary school. The 
high school records are the results for a single observer 


Tabm: I,—RuLiADiniTY of WinsPEK SconiiB 


Group 1 

I N 1 

j r, 10 oba. 1 

rfBp, Bi),20 oba 

IB 


20 

33 

ZB-2A 


7S 

88 

34-3B 


70 

8G 

4/1-45 


60 

75 

65-4/1 

35 

43 

60 

05 

31 1 

20 

45 

6/1 

30 

36 

62 

12 

27 

80 

80 


Distribution of WiiiBiusn SconEb 

Under the conchtiona of tlio method, the child wlio whispered in 
eaoh of ton fivo-mluuto inLorviils would have n score of ton, while the 
child who did not whisper at all would havo a score of zeio. Scores ior 
the elementary grades (Table II) varied botwoon zero and eight, 
with a moan manifestation of 2 2 vSinco tho score foi each child 
m the olcmonlary school is the average of locords fiom two obsorvors, 
tho vaiiabililios of the scoies are soinowhat curtailed. An oxaminalion 
of the tabic reveals the piesonce of a largo nuinbei of zero values 
In a sense, tho method fails to diffcrontinto about 33 per cent of the 
elementary grade childien. Piovioiis cxpcrionco with the method 
in the measuremoni of other typc.s of bohavioi suggests that added 
observations are needed in oi dor to fui Llicr diffcrcntiato the zero scores. 
Tho scoies for the single observer of tlie twelfth grade vary between 
zero and ten with a moan of 4 5 and lelatively few zero scores. 

No rcliablo sex differoncea appear in the table. Although the data 
were sexed for purposes of analysis, the lack of any constant trend has 
led the wiiter to deal with only Uie totals in the remaindei of this 
report 

Helation or AVirisi'Eu Scoiiios to Grape in School 

No clear-cut rchUionslup between the mean amount of wlnspcimg 
and tho grade in school can be deinoiistratod with tho number of cases 
available (Table III) Tho data suggest a largei amount in the first 
grade than in subsequent grades in the cdeincntary school On tho 
other hand, a previous tabic (II) sliows an almost equal amount in a 
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group of high school scniore. It would appear that tlic gross amount 
of whispering in a particulai giadc is a function of ilio situation rather 
than the reflection of any fundamental developmental continuum 
Deviation fiom the mean of a given bitualion is proliably of more 
significance than the raw score Such fluctuations as arc found from 
loom to room cannot be attributed solely to cnois of ineasuiement for 
two observers lend to give similcr descriptions (Table IV) 


Tadld II,—Dihtkidotion of WiiiBvr.ii Kconrs nv Hkx 



Elementary grades* 


12th grade 


iScoica 



; - - 



— 


' Boys 

Girls I 

' Total 

Boys j 

GjrJs 

Total 

10 





2 

2 

9 




, 

1 2 

2 

8 

1 


1 

^ , 



7 

1 



1 


1 

C 

' 2 


' 5 

1 


1 

5 

6 


10 

3 

1 

4 

4 

0 


11 

3 

1 

4 

8 

19 

13 

32 

6 


6 

2 

16 

13 

28 

2 


2 

1 

27 

30 

67 

1 

1 

2 

0 

32 

43 j 

76 

1 

3 

4 

N . 

109 

116 ’ 

224 

17 


27 

Md 

1 8 

1 6 

1 0 

3 0 

6 0 

4 1 

M 

2 3 

2 1 

2 2 

4 0 

5 3 

4 5 

SDa\3 

1 8 

1 0 

1 a 

1 7 

4 2 

3 0 


^ Cfisea without age records omitted from this tabulation. 


WiIISPEHING^ iNTEt/LIQENCE, AND SciIOQI-i ACHIEVEMENT 

Intelligence quotients, based on a single group test, were avail¬ 
able for children in the 6A grade. The coeflicicnt of con elation 
between whisper scores and intelligence quotients was — 34 ± 11 
Intelligence quotients, based on the mean of five group tests, and 
honor-point ratios, based on all marks for tlnco years of high scliool 
woi’lc, were available for the small gioup of high school seniois. The 
intorcorrelations aic presented in Table V. The i elationahij) of whisper¬ 
ing to honor-point ratios ( — 30 ± .12) is liighcr than that with mtelli- 
gencQ quotients (—.17 ± 13) Data on laigcr gioups me necessary to 
establish these trends with certainty. The evidence available suggests 
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tliat whispcimg i8 not simply an adventitious circumstance, but is a 
reflection m pait of adjustment to the classroom situation The more 
intelligent and scholarly, interested m the -work of the class, adjust to 
it and whisper less. It is conceivable that the lolationship would 
change under vaiying eonditions of work and iiitorcst 

WlIIBPKUlNG AND MaUKB IN CONDUCT 

In n sense, tlio validity of the whisper scores is intiinsic and relia¬ 
bility and validity cocflioienfcs become synonyinous for the narrowly 
defined belmvioi which is the subject of study. If now a claim is 
made that the whisper Rcoies aic Bymploinntic of bioador categories of 
bchavioi, external criteria must be used to evaluate the method 


TAUiiE in —Wnisi’Kii SconKB by Ouadbs in an Illi,BMDNTAn.\ Sciioorji 



3B-3A 4B-4A 6B GO-QA 


4fi 49 22 69 224 

0 « 1 8 0 8 1 3 1 0 

1 4 2 0 1 2 1 8 2 2 



1 Caso3 witiioul age iccoids omitted from this tabulation 


TahI/C IV —CoMPAitisoN or Mkan iScoims and Vaiuauimty or Two OnflDnvDns 

IN ICacK CliAHHIlOOAl 




Mean 

Room 

N 

Obfloivei 1 

. 

Obsci ver 2 

IB 

32 

06 

1 4 

2A-ZB 

35 

2 9 

2 1 

iB-iA 

40 

2 0 

2 6 

QA 

30 

2 0 

2 5 

RB 

31 

1 0 

1 2 

3B-3A 

34 

1 4 

1 2 

4/1-6B 

36 

1 4 

1 0 


2 0 


1 0 
1 2 
1 7 
1 2 


Observer 2 

2 0 
1,8 
1 4 
1 9 
9 
9 
7 


Childien in the ('lemtmtaiy seliool htudiod wcio given maiks m 
conduct by teachers in gnulo.s tliroo and jibovo 'J’lio iiuuks weie in 
teims of letter latings, A, li, C, />, and E. 'Fhe summary for a 
semester was taken as the murk for ouch child Thcie is a suggestion 
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that the Bjgniricaiice of whispering as one of the criteria of conduct 
incieasea as one goes fiom the ficctloin of the early school years to the 
more formal procedures of the upper grades (Table VI) 


Table V —RBUTiONSiiir lihTWEnN Whwi'ku SrouEH and Oriuni Vahiableb in a 
Ilian Sciiooi, Class {N ° 24), Peii Cent 



Tabld VI—Tuu Hklation oif Wnwi’nn Scorch to Maiikb in Conduct in 

SucccHBivE Grades 


6i7 . 
5i-62i 
iBAA 
3A-4B 



SiJMMAIlY 

A group of sludents in a couiso in the psychology of peisonulity 
collected data on the occurrence of whispering in clcmcnlaiy and high 
school children by the use of a time sampling leohniquo. Each student 
made ten consecutive five-minuto observations The ichabilily 
coefficients for the average of two unprncticcd ohsci vers varied between 
.33 and 88 in the rooms studied. No significant sox diffciences 
appeared in the mean whisper scores. The amount of whispering 
present in the various grades appeared to be a function of the situation 
rather than the reflection of a developmental tiend The evidence 
suggested that the more intelligent and soholaily whispoied somewhat 
less than other children. The significance of whispering as one of the 
criteria entering into marks of conduct increased with the grades. 









REPLY TO PROFESSOR KELLEY 

KAllL J. IIOLZINGEU 


Uiiivuifiity of Cliii‘ago 

In the May iRsuo ot tlaa Joinnnl Professor Kelley has taken objec¬ 
tion to 8omo (lominontR I !uiv(‘. inado’ rcKaitlmg an example taken from 
lus book, “CrossroadH in the Mind of Man " 

To save print I lefer the render to the data in tlio papers cited 
above In my Maicli paper I tiled to do the following things* 

1. Show that TJioindike'ft (JAVI) mfcolligencc test has a common 
factor with three othei testa and dotcimiiic its coiielation with this 
fftctoi* {)ig = flG) 

2. As an cjiamplc that a "imvavmoiuows" explanation of cou'olations 
la desirable I look four out of muc tests fiom some of Piofcssor Kelley’s 
data and found one coinnum factoi an adequate explanation. I 
then gave Professoi fxelleys’ pattern linsod on tlicse four tests and 
five others. This pattorn was veiy claboiate, having one common 
factor, tluee sufi.slantial group factous and .several specific factors 
On p. 104 of iny ai tide I .say, 

The above cxnin()l(' is but njragmcul of Ihofessor Kelley's woik on tlieac data 
and 18 not included by wav of ciiticwm, Imt mciely brraiiflo the immcrnl work 
was at hand Afl far ns these/oar lenln are concerned wo liold that pattern ( 1 ) 
18 adequato. Piofcsiov ICelUw omplovs Iho elaheuitc \mlloiu lu the above table 
and inlorpiots the coimnoa faetoi et ns “ln*toioKeneity, miLtuntv, sex, and race ” 
Wc argue that the factors a, p, y, S, c, cte mo inmginlieant in thovso four tests, 
and that wliiiLovcr eonnnon factor ib found mav he lugaulcd as p (Itahcs added ) 

Professor Kelley (he vd ) cimrges me with the following errois: 

(a) A false picscntaCion of his argument because otlicr elements 
of the piobloin weio not coiihidcrcd (p 30o), 

(l>) XJna>Yaicness that when inoie vaiiablca aie added to a given 
set the pattern explanation liccomcs move involved (p 305) 

(c) Overlooking point in the mtcrpietatioii of CAVD (p 
366). 

(d) Imiiliccl charge that 1 (or people like me) would take four 
tests with conunon {/, then lake foui otlier to.sl8 with a common 
and fxom these two lesuUs Hay y — (p 3(H)) 


* IIol7iiiger, Karl J Thonidiko’a CAVD ih full of 0, 
Piychology, Majch, 1031, 
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With legard to point (n) I may say tluit 1 was aware I had taken 
only a part of Professor Kelley’s data Kvulcnco of such awareness 
IS in the paragraph cited above. I was not presenting any argument 
of hia ciihoi falsely or otherwise 

I am aware and was aware of the fact Unit when more variables 
arc added to a set, the factor pattein may become inoio coinplioatecl. 
Thus, if wc have an explanation for four varialdcH ri, r 2 , .Ta, and ^ 4 , 
this explanation may not suffice when wo add xg, Profossoi Kelley 
notes that we may get a gioup factor botwoon Xi and .Ts He does not, 
however, explain how the afUUlion of moie varialrlcs to the original 
tests with no group factor, introduces scvcial gioup factors tn Ihe 
onginal fo)m, An explanation la possible, and would have been 
more to tlio point than tiie aitificial data in his I'lilik* I, p 1505 

As zcgrti'ds the ('AVI) test I see no jiwtiAcalion for the clmigc tliat 
I was imawaro that oUim teals might have given a cliffiu'ont result. 
Professor Kelley’s icnmik on p. is paiticiilaily misleading "To 
fionerahijc from the rolation-ships found in four tests lo riOationshipg 
supposed to lie in the mind of man begs the que-stion, for doing so 
involves the assumption that tlie four tests sample the ontiio mental 
life ’’ I agree with this quotation ns a stateincnt of a gmicuil principle, 
but not if It IS applied as a oiiticism of what I luivo <lone with the CJAVD 
test and ihioe otheis (which were all ProfcBsor Tliorndiko finniBhecl 
me). Note that if tlio number “nine" bo siihHliluLod in iilaco of the 
number “four” in this quotation, the aaiiu' criticism apphe.s in loss 
dogiee lo Professor Kelley’s own data Siuely the moie tests wo have 
and the more ncaily they cover the areas of mental life, the better the 
opportunity foi a complete piciiive of .such life 

My own study showed that OAVD is full to the extent r = 96 
with the same thing that three other so-called intelligence tests con¬ 
tain to a large extent On p 90 of Jiis mcasuiemcnt of intelligence 
Piofessoi Thorndike makes the following iiifoience from the same 
correlations I employed. " Intellect (’AVI) is very much the same thing 
as that which ismensuied by repirscntativc examinations for so-called 
intelligence ” All I have done i« lo show the same fact moie precisely 
and to indicate how much OAVI) is saturated with this “same thing" 
present in otlier tests of so-called intolligciico. 

The charge that someone might say g - g'‘ when those two aio 
obtained from diffcvont tests is too absent to more than I'ocogiu/.e as 
such 
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Reply to Professoi Kelley 

I may say m concluaion that I am much mom inlorestecl in getting 
at the ii'iith about factor analysis than in getting the better of an 
argument, An argument, however, may bring to light the crucial 
aspects of a tlieoiy a little more vividly than one sided piosentalion 
The point lieio eiiipliasisod I believe to bo, that factor patterns arc 
functions of tlic tc.sts we use They arc also functions of the groups 
we test and of niaiiy other things. JOxcept foi this point I shouldn’t 
have written Hits reply liecau.se I am certain Pi'ofc.ssor Kelley and I 
are m substantial agiecment on all points at apparent issue 



THE INFLUENCE OP JAZZ AND DIRCiE KUSIC UPON 
SPEED AND ACCmiACy OP TYPING 


MILTON n. JENSEN 
WcatPrii Konliioky Slutp Toacheia Collogp 

Tins study wns iniulc at the ^I’mining Hehool of the CVnlial State 
Teo.chci'3 College, Michigan, thieo weeks before the olos(5 of the spring 
somoster, 1930. Fifth, eiovciith and twclftli gnidei.H (twelve boys 
and thiity-Giglit girls) in three typing cla.ssrs numberjng seventeen, 
seventeen and sixteen lespcctively wore u.scd as subjects All had 
had" tliirty-seven consecutive weeks of typing instiiiotion in the high 
school In ago they ranged from fifteen to twenty-two yonrs (average, 
17 88). Speed and ncciuaoy weio measured under tluee conditions, 
heicaftcr called states of dialraotion: 

I. Noimal —This wa.s iclatively free from distractions, being 
typical of the regular class procedure Passing through the coiridois 
was infrequent during these pcrioda and thcio were few of the noisca 
common to schools in many of our popiilalion centois Whether this 
latter fact means that our Bubiocls were more suHceptiblo to distraction 
than they would be undci city ooiidilionH wc cannot say 

2 During ike Playing of Jaza Music on au EdmJi Phonograph, 
Cabinet Model. —A heavy steel needlo was used in playing all the 
lecoi'ds, the tempo was kept normal and no changes wcio made m 
volume control. The jazz selections were: “Valencia,'' Perfect Kecord 
//1'1626, played by the Mayflower Scroiiadcrs, “At the Pioin,” Victor 
Record //38105A, played by Irving Mills and his Modernists, and 
“Bugel Call Blues,” Victor Record #38105B, played by Jack Pettis 
and his Pots. 

3. During the Playing of Diige Afusic —The seleciionR lepioduccd 
were' “Death of Asc,” Victoi Record #35470B, played by the Victor 
Conceit Orchestra, “Thais Meditation," Victor Record 
played by Fritz Kreisler accompanied by Carl Lnmson, and “Indian 
Lament,” Victor Record |G186B, played by Fiitz Krcislcr accom¬ 
panied by Vincent O’Buen. 

Practice effects woio conirollod by testing each of the tlirce classes 
separately under all three conditions on tliiee aueco.ssivc days anrl vary¬ 
ing the order of testing so that, when the data for the tin oo clnssc.s were 
combined, equal amounts of practice would acciue to each method 
Thus class “A" was tested in the ordei: Tuesday—normal, jazz, dirge, 
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Wednesday—jazz, dirge, normal, and Thursday—dirge, normal, jazz 
Class “B” was tested in the order; Tuesday—jazz, dirge, normal; 
Wednesday—dirge, normal, jnzz; and Thuisday—normal, jazz, dirge. 
And class “C” was tested in the oidci: Tuesday—diigc, normal, jazz, 
Wednesday—normal, jazz, dirge; and Thursday-jazz, cliige, normal. 
Since the classes weie appioxunately equal in sizo and since the testing 
all came at the sanui hour of the day, this proceduic may be thought 
of as supplying an adoiiuato control of practice effects 

Three separate hvc minute typing tests were used, all being admin¬ 
istered in the same order to each of the classes each of the thiee days: 
Test No. 4, p. Gl, “New national Typewnting” by R. P. Soielle, 
published by the Gicgg Publishing Co , tests put out by the Royal 
Typewriting Co. in May, 1929 and April, 1930. Estimates of the 
reliabilities of those tests were secured by coirclating the scores of the 
students in words per inimito and applying the technique devised by 
Di Shen in 1924 ^ These icliabihtics m the older, Sorellc, Royal 
1929, Royal 1930, wcic: under normal conditions, 02, 74, .57 (av., 
.64); during the playing of jazz, .89, .56, 68 (av , .71); dining the 
playing of dll go, 70, 85, .46 (av., 67). 

It will be seen that tlichC examinations aic accuiate enough to 
justify their use as moasiiros of group dilTeiencea Assuming the 
rchabiUty of each RhI equal to the iwciage of the three tests, for each 
of the tluec states of distraction, an applicaLioii of the Spcaiman- 
Brown foimiila gives a ichabihly of .84 for an averaging of the test 
scores under noiinal coridiLions, a I’elinbility of .88 duimg the playing 
of jazz, and of .86 during the playing of diigo music ^ 

While the dihcreuces in these cstimatca of rchabihty arc of no gieafc 
statistical importance they do show that the accmacy of our measures 
is not impaned by the distractions used What change theie is, is in 
the direction of improved accuracy—an increase of 04 with jazz over 
the noimnl and of .02 far diigc over the normal. 

Since typing icsuUs, traditionally, arc measuied m words per 
minute the eficcl.s of the dibtiactious upon the reliabilities of the tests 
weiG determined in this unit. In dctciminmg the effects upon student 
porfoi malice, howcvei, we have cxaimncd the speed of sinking the 
keys (numhor of aU'ol\ 0 .s) and tho number of errons sopuiately. Table 
I gives the average miin\)er of alioki'H, ciiovs ivm\ woi ds per mmule for 

* Shon, E Tho iloliahiUty Cooflloioiit of IVisonal Hritings Jaurnnl of Edit- 
calioml Psyclwlngi/, Vol, XVI, 1025, pp 232-230. 

^Kelley, TL, "HtahBLirttI Method,” p 205 
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each of the tlireo states of chstiaction, together with the probable errors 
of theso means. 


Table I —AvniiAOc NuMnui oy Stooklh, Kinioiis and Wniius piiii Minute for 
Typing unduh TiniBn States op Distraction 


1 

Normal 

Jazz 

Dirge 

Strokes 

215 08 fc 3 70 

216 80 1. 3 82 

200 00 ± 3 28 

Enors . , 

Q37 1 040 

1 212 1 0S2 

01)7 i 063 

■\Voi(la 

33 04 i 02 

31 00 LI 04 

32 03 1 80 


It IS scon by inspection that ja'/// uuiaic had no appi'ccial3lc influence 
upon the typing speed of our subjects aa meagured in stiokcs per mm- 
ute. The dirge, however, brought about an avorngo dccicaae from the 
normal of appro\imiitoly five strokes per minute—2,37 poi cent 
This mean difTcrenco (5.09) divided by its standard eiror (2 41) gives 
2,11. In terms of normal probability areas, the chances are nine 
hundred cighly-throo in one thousand that the dirge as a distmclion 
deorensed the speed of striking the keys When the number of cirors 
per minuto of typing is examined, however, a difTcioub picture is 
pro&entcd. The dirge, which inatoriiilly leduccd tlie H]-)e('d of sinking 
the keys, actually reduced the number of oriois, leaving the end lesult 
(number of words per minute) little dilTcicnt from tlie normal. Jazz, 
as a distraolion, mailccdly increased the numl^or of errors— 50 per cent 
ns against .44 per cent foi the normal. The mean increase in eirors 
per inmulG (.275) divided by its slamlaid ciroi (038) gives 7.24, 
leaving no doubt as to the seriousness of tlie influence of jazz music 
on typing, so fai as cirois arc concerned. The mean number of words 
per minute is not appreciably lowci with diigo as a disti action than 
under normal conditions, but jazz, despite its lack of effect upon the 
number of strokes per mmutc, seriously affects tho final score in woida 
per minuto, because it is conducive to ciror, Oui subjeois, on the 
average, typed 2.58 fewer words per minute with jazz than under 
normal conditions—a decienso of 7.67 pci cent The standard crioi 
of this difference is 796 so that the diffeicncc (2.58) divided by its 
standard orior is 3 24. 

In examining tho relationship between spend and uecunicy, the 
number of strokes and the numbei of crrois wcic ooiiolatcd (product- 
moment) for the tlnec stales of distiacLion. They woi'c found to bo: 
under normal conditions, - HI ± .094; with jazz, - 191 ± 092 ; with 
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diige, -.508 ± 080 Had our populations been huger, more extensive 
examination would liavo been made of the ranges of ability most 
seriously influenced by (hbtraotiona of this sort The relation between 
speed of typing and susccpLibility to distraction is a problem of con¬ 
siderable impoitancG to botli the bumnesB man and the educator 
Unfortunately, our dnUi caimof. solve the piolilcm as tlio writer should 
■wish 

It 18 of interest that speed and eiroi* arc so little iclaLod under 
normal conditions A plotting of the percentages of erior given in 
Table II shows ii marked n.se liirougboul the middle dceilcs as opposed 
to a gradual dropping oil which one might lie led to expeot. Tins 
situation IS even more marked with jazz as a dietracUon. With the 
dirge the tendency is still piesent but the decrease comes earlier—m 
keeping with tlio stiong negative correlation between speed and error 
under tins typo of diHlraclion. Table II gives fcho mean iiuinbor of 
strokes per minute and the mean percentages of error for the deciles of 
the distribution under oaoh of tlio throe stales of distinction. The 
clcoilo ordci is the frame throughout as under normal conditions, no 
ohangas being made for changed positions with jazr- and dirge as 
distractions 

Taiii.bII —Mkau Ktuoi v.rvi.u Minutb and Pwicrn'i’aovib or Eutiotiiiy DBCinna 
frOK Timi.i. STAThs or Dihtuaction 
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exlremcs. Other typos f>f rausjc jniglil bo expected to Jiave offoots 
intermediate between the influences of those two It Hcems reasonable 
that any porfoimance calling for rapidity and skill of movement will 
meet intorfererico from atimiili as intiiuliiig ns Llio extremes of jazz and 
dirge employed m this stiuly.^ The maginUide of this intcrforcnoo is 
indicated by our results. To what cxtcuit accommodation might 
offset tlio distraction over n piotinctcd period of time, wo have no 
menaurc The safe proccduie, where speed and accuracy are 
demandeclj is to avoid distinctions of tins typo unlcHS it can be domon- 
fitratecl that accommodation has taken |)lnco to such an extent that 
performance will not bo materially affected 

^ Tlie water hnfl made apreliminftry study of Iho effects of the radio upon simple 
Arithmetic compulations. Data for sixteen subjccU adding singla digit niirabera 
■during sixteen fifteen-inmuto expenmcntal periods (eight with the ladio and eight 
without—alternated to obviate practice offocts and distributed over eight days) arc 
strictly m keeping with the losults obtained from the typing olasses, Speed was 
nob materially affected but tlieic was a deeieiiso of eiRlil in tl\o percentage of 
accuracy—nmcly-lhreo per cent of Iho additions attempted without tlio radio wore 
correct and only cighly>tivo per cent of those Attempted with the radio going wore 
correct 



A PROOF THAT THE POINT FROM WHICH THE SUM 
OF THE ARSOI.TJTE DEVIATIONS IS A MINIMUM 
IS THE MEDIAN 


PAUL TIOIIST 


Personnel lli'seaieh Depuitincnl, IJnilrd Slates Civil Servico Commission 


It IS quite Roncrally known Ibnl the iiuvlinn value of a statistical 
series la that value fvoin winch the a\nn of the absolute deviations la a 
minimum. Elenieiilaiy IiamlbookH on statistical method sometimes 
refer to this fact but since they aio not concerned with derivations, 
they offer no matlioinatical proof. Both Yule^ and Kelley'^ demon¬ 
strate the truth of tins Blatement by shoiving that the absolute 
deviations would be greater if taken from any other point than the 
median 

The \Yritei’ rather lucidcntuUy diacovcrcd a proof winch is more 
clean cut than any lio lias seen, and it might be of some interest to 
others Instead of showing that the sum of the absolute deviations 
would be gi'Cttlor if incamiied fioin any other point tlmn the median 
wo may show with a nioic giMicrnl iippionch that iho point fiom which 
the sum of the aiiHoluto (leviations i8 a miihmuin is ilie median. 

Ibral we deuvo the general expicasvon for the average deviation 
from any point. Wo liavo given a statistical senen, 


X 2 , 


Ami Ant-I If Apjjj, . 1 A)i 


arranged in order of magnitiulo, whore all the values up thiough X,n 
ho below any point P, and all the values above X,,, He above this point. 
Then the average deviation about P will be, 


AB/. = 


N 

r 

N 


ABp = 




wiH I 


mP — — (a — m)P 


HI-I 1 


2) X, — — (2?n - 7 OP 

mil 1 


( 1 ) 


which IB the saino as foinuila (8) given by Kelley.® 

‘Yiilo, G. U. "Iiitioduction lo tho Tliwiy of .Stalwlics’* P li'l 
‘Kelley, T L . “SLatwlWfvl Melliwl ” P 74 
‘Kclloy, T L , “iSlatiitiPft! Method" 1* 73 

4U3 
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Now WR wisli to dcteimincP in (1) ao that ADy. will be a minimum 
To do this wo simply di(Terenlmto (1) witli respect to P and equate the 
derivative to zero. Thus, 

__ - Ji ) _ 

(IP ~ N 

Thou solving foi m in terins of n wo have aiinply 

7)1 = • 

That IS, half the values aio lielow P and Imlf above, which is, of course, 
the definition of tlio median. IIciicc that point fiom which the sum 
of the absolute deviations is a niiniinuin is the ni(‘dittn 


( 2 ) 

( 3 ) 



relation between use oe different parts 

OF SPEECH IN WRITTEN COMPOSITION AND 
aiKN'DVL ABILITY* 

CIIAM.KS r LOOMIS AND ANNA MAY MORAN 
North Oaiolma Slati* Cullrgo of AgriciiUtiip uiid EiimiiporinR 

Since spencli is imorl diiccUy or indiroclly moio than nny oUici 
single human aiiubutr us u cutorion by which to doteiniine Jiidividiial 
mtoUigencc, il would appear acIvantagcouB to ascertain the lelation 
of speech to mental ability fioin every possible angle. Most mtclh- 
gence teats at the present time demand either speech reactions or 
reactions to speech stimuli, or both The problem undertaken m 
the present study is to discover the relationship between the propor¬ 
tion of difterent parts of speech m writing vocabularies of mdivulualB 
and their mental ability 


I 

The importniico of InnKUiige in human activity is strosscfl by most 
paychologisls, sociologists, unci cultural ttufchropologislK It is gener¬ 
ally considered to bo the chief vcliiclo by which the oxpoiieiicc of the 
past and present is transmillod. Speech has mnde human culture 
possible and man a “ time binding animal ” I'o quote fiom Profcssoi 
'Cooley: “Language ih Uic vehicle by wliicli human relations exist and 
develop—all the symbols of mind, together with the means of con¬ 
veying through space and picscrvmg them in time, exi)ie3Sion of fact, 
attitude and gcsLuic, tones of voice, printing, and everything m the 
way of mental giowth, has its existence therein Without language 
the mind docs not develop n tiuo human natuic, but remains 
m an abnoimal and non-desenpt state neither human nor piopcrly 

brutal.”2 

So closely la language iclatcd to mtclligouce and the piocesses of 
developing mental ability, that it is believed that if one could moasuie 
an indivKlual's language iilulity he would Imvc a fair index to that 

‘ The nrticlc is a Hiunumry of a ninstor'a Iheais pirsontcd nt the N C .Slate 
College, umloi' the (luccUou of Di luirl G. tlauison, I’rofoHwu of Educational 
Psychology. 

* Cooley, Gluirlos IhnUui' OiKam«ilum ” Ghailcs Hcubnoi’s Sou?, 

York, 1000, p (12 
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individimrs goiieral niontal aljility “It lias nflcn bc*oii said that 
thought would be impossilde without words, and ifc is true tliafc we can 
hardly conceive of huiium IhouKht save as formed and embodied and 
expressed in language Thouglil and uiticulalc speech gicw up, so 
to say, side by side; each implies liie othci, they me two sides of the 
fiame phase of mental development 

A gicat many studies have h(‘en made to deternuiio the relation 
between vocabulary nnd .speech ability and general intelligence For 
instance, Teunan found eorielalions ranging fiom 85 to 05 between 
Ins vocabulary test scoies and ihcseoies made on the Stanfoid llcvision 
of the Binet test.- Lockwood^ foiiml the coiielalion Ijotweon composi¬ 
tion scoiG.s based upon Iho Jliideleson seide arnl tlio seinGstcr giados of 
ficslimen to bo .77 ± 020. Lockwood also found a correlation 
lictwcen general intelhgcneo (Oils lest) and eomposition scores of 
fifty-.scvon boystobe 67 ± 05, and of foily-lbiec giils to I)C 70 ± .04, 
and concluded that a high degiec of intclhgenec i.h directly rclntocl to 
ability to wiitG adciiuately Sangieii' arrived at a sninlnr conclusion 
afloi a study of luutli grade pupils; but Hoss,*^ who Htiulicd twelfth 
grade pupils of supenoi inontal alality, leported a hielc of coirelation 
between iiitclligcnco im<l aohioveiiient m Kiighsh eoniposilion. 

Oloser to the problem at liaiiil is tin* analysis and clasMlication of 
different parts of speoeh used iit diHoiciit peruxls of language giowth. 


^Tltchciioi, E B “A Bogiimcr's Psychology “ Thr> Miuuiiillan Conipany, 
Now York, 1017. 

2 TGiiiian, Lomjs M cl nl “(Joiieltc Studies of (SoimiH," Volume I Stanford 
Univcisity Prosq, 1925, p 26 

sLoolvWood, II R 5 Couelnlioii of Mmilal Maturity of Ono Hundred Gollcgp 
Proslnneii and Then Ability to Wiitc English Composition UnjnihlidicU Ma-ilcr's 
thesis, Departnu’nt of Education, Umveiuity of Chicago, 1025 

Among Btvidios of this kii«l nio tlioso of Hughes, W II The Relation of 
IiUelligom'o to Vocabulary nnd Lniignago Tinnung Knghah Journal, Vol XIV, 
Oct , 1925, nnd Ihillei, A D. Intclligeiico Tests niul Aohicvemeiit in EorIisIi 
C omposition, Educalional Adminitltalton and Superomon, Vol XIII, Jnn , 1927, 
and Gainson, K C . Tho Jtclahonship between Thtee DifTcront Vocabulary 
Abilities Journal of Educalional Ilesmrch, Vol XXI, Nuinhei 1, Jan , 1930, pp. 
43-44 

^Sangren, Paul V • Intelhgenoe Tests niul tlio Clussilieatioii of SLiulenls in 
Ninth-prado English Educational Admim^tralion and y^npermwn, Vol IX, Dec , 
1923, p 547 

^ Boss, Mabel E • Tho Ilolntion of Poifoiinaiue in Mimlnl Tests Ui Achioveinent 
in High School English Unpubksh&l Muster’s IhcsiH, DepiiUiiient of Education, 
University ol Minnesota, 1925, p 89 
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In this lORurcl, discrcpancio.s in the ohissifioation of certain portions of 
language activity have arisen l-)coa\isp of the clifTiculty of assigning the 
pait of speech to the sumo word or expression iinclor different condi¬ 
tions A suminaiy of the litciatme on Iho relative number of the 
various pints of speeeh was made by (J. W Waddle, in 1918, with 
the following riiidingM/ 

1 Iiitorj(‘(Uion(il Hja'ceh wuh (Imuuitf'iiHlic iit tlK* bfRiniiiiifi 

2 Nouuh wore used eiuly lu relatively liuse uuinUcrs 

3 From tlie fust j eivi on, the ViTlial element wiib iclativelv laige 

<1 The piopoitioii of ndjfS'Uves to adveihi wns greater at yoimger ages 

5 Peisoiinl pionouns, relative pionouns, uinl Hulioidinating and connecting 
wouls, weio aeciuiieil with dillioulty. 

These htudies, liowovcu’, have boon conhimi to the mveatigalion 
of tho (powth of iho use of tlio diffcionfc parts of speech Boyd,® in 
his study on tho dovclopini'nt of Hontonco structure in childhood, 
devotes a section to the ohunonts in tho vocabulniy. lie says. "Com¬ 
ing now to i-ho words wliirli are components of clauses and sonlcnces, 
wo may coiisidoi tho icluUvo poiooiitages of tho diffciout parts of 
speech III tho total woi<1h of the colloolod sontonces of the child (count¬ 
ing oach woril oaoh tnno li oonnr*') ” 

The poicoiilagoH of (lio (lillcroiit parts of spooch of tho child studied 
by Boyd do not dilfoi gioady from thoso of the study winch follow.s, 
but thoy aio classified didioienMy. His compaiifeon of the vaiious 
pill ts of spocdi used by 1 ho growing eluld with thoso of male and female 
novelists IS inLoiesimg. Tho ptnoonlago. of lolatuuial words (conjunc¬ 
tions and proposilions) in adult soiitoncoa aro qiuto highci, but tho 
pcicentagc of voihs and advoihs associated with them is considerably 
lowci. Nouns and pioiiouns togothei aic of about the same fic- 
qucncy in ehihhon and adull.s Adults tend to use more nouns than 
pronouns, but tho clnldien uso nioie verbs than tlic novelists There 
was not much difforcMico bolwoi'ii tho men and woinon novelists with 
legaul to pcicentugo of jMwtB of speech used, 

In a lecent monogiupli, Symonds Jind Lee pioscnt data gatheicd 
for the piiiposo of analyzing tho dovolopmont of vocabulary usage in 
writton coinpnsilion, ami io dotoimim' tlio changes that occur m the 


MVadtllc, C; tv ’ “All liituidiiciKin to Oliild Psvdiology ” ITougiiton-Mifflm 
Com|)any, Boston, 11)18, ji 71 

i Boyii, Williiim Bnli'ih Jow nul of }'v/(}ioU)gif, Yo\ XVII, 1927, pp 181-191 
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use of words as the child bccomcH moie and more innluie. In their 
concluBiou they say: “It waa aurpnaing that the per cent of changes 
arc so slight. A few basic articles, conjunctions, piopositions, pro- 
noiuiB, nouns, and vcibs seem to be Iheframewoik of the Inngimgo and 
are used whenever language is used.”* One might anticipate from this 
concluaion that there would be little viuiution in the proportions of 
different parts of speech used by clifferont ages and intolligonce This 
was found to bo somewhat true m the present study, but theio was 
enough variation about the avcmgcH to wiiirant fuilher statistical 
ticatment involving correlations. 

In a study of high school pupils' vocnbuUines, O'Bnon^ found that 
the number of adjectives used by students iiioreasod steadily as the 
school grade increased. This was also found to bo true of woids or 
phiasGs pertaining to abstract qualities or uleiis. lie states that 
“it was felt that the extent to which the pupil used well chosen 
adjectives would provide a significant index of the precision and 
clearneRa of hia thinking na well as a gauge of that phiibc of his vocabu¬ 
lary." Of course it would be hard to treat the “well chosen adjec¬ 
tives” quantitatively, but the increase in the number of adjectives 
used as higher school grades aic attained might indicate that there 
is a relation betwoon mental ability and proportion of adjectives 
used. 


II 

The data for the present study woio obtained from the Junior 
division of the New Ilaleigh High School, llnleigh, North Carolina. 
Composition work of thiee gioups, two ciglilh and one high seventh 
grade, was used. The composition papcis wcie collectod at different 
intervals throughout the fiist term of the school year 1929“1030. In 
order to allow the students to have os much freedom as possible in the 
use of their vocabularica, the subject-matter for the compoaitiona wna 
left to the writers. As a consequence, the compositions vary widely 
m their content as a statement of their analysis show, on p. 469 

In order to keep ns close to the aim of spontaneity ns possible, it 
was necessary to reject some themes wluoh had obviously been written 

* Symonda, P M. nnd Baldwin Leo. iStudicH in LfiiniinR of Exinoasion, Number 
III—Vocabulary. Tcachors Odlege lieeord, Vol XXXI, Ootohor, 1920, p. 60. 

* O’Brien, F P.iTho Vocabulary of IIighHchool Piipila in Wutton Composition 
Journal of Eduoalional Research, Vol 11, 1025, pp. 331-360. 
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by pupils who had rosortod to loforcnco books for facts in order to 
write the pai ticiilar theme handed in. Long lists of proper or cornmon 
nouns wcio also omitted. 

As a mode of proccduic the following classifications of speech wore 
set up: (1) Nouns and pi nnoiins; (2) verbs and verb forms; (3) ad] octives 
and adverbs (modifiers); (4) coiijunctions and piepositions (conuec- 
tors); and (5) the articles a, an, and the. In order to make the division 
of the words into diffoionl oalogoiics ns objective as iiossible, words 
were assigned to thoiv division only after ascertaining how they wore 
used in the sentence. Hidwcll and Sicgfiied'a Handbook of Grammar* 
was used ns a guide. 

Table I —Auiuthauy Analybib of Tiiar.n lIUHoann Twenty-bix CoMPOBmoNB 
Written ry ISiqiity Hioir School Students Who VVbub Allowed to 
Choose Tiidiu Own 1<'o»m and SuDjECT-MATrER 

^ NUMDEn 


nAi.TiiEMEi OP Composition SeounED 

Description —nature, lopioa of mlerest, experiences, animal life, persons, 
holidays, geograplucnl loeahties 107 

Ciwc3—tariff, Pan-AmoiWan eongreas, lA*aR«o of Nations, eonstruotion 
of tho (loveriunenl, duty iw citi/eiis, current events of iiUorost 91 

Narrative —complelion of stones, converenlionH, Stoiv of Evangolino 04 
Exposition —"How to Make,” etc , "IIow to Earn Money," "Itow to 
Live at Homo," "Why Study Lalm" 27 

Le/iers—personal, and lotlors of npphcRlion 20 

Moral iJaaoi/—intoipretiition of stones with mural 17 


Total 326 

Average number of eompositions per pupil 4 075 


After the wouls of each sLudeivt’a composition had been classified, 
the i)ciceiitagc3 of llio total nuinbor of woids used by an individual 
classified under tlie difToroiiL catugoiies of the pnits of speech were 
found, for each iiiflividual separately In all cases all words were 
classified so that the sum of the percentages of the different parts 
of speech used by each individual always amounted to one hundred 
The table on p 470 .shows tlio averages and deviations of individual 
percentages of diffoient pai Is of speech used Aitides have the highest 
coefficient of vauabiUty 

In oulcr that relationsliips eould he found botwemi list's of different 
parts of speech and mti'lltgeiur, cerl.iiii indices of tlie mental abilities of 

'Sulwell, Paul aiul UnsHell Cr Sicgfin'd' "Ilandlioolc of Grammar ” Charles 
Sonbnei’s.Sojis, New Yoik, 1028. 



470 


The Journal of Educational Psychology 


the students whoso oompobUioiis wpkj iiniilyzcd had to bo obtained. 
The fust measure used was the TVrinaii (iwiup Test of Intelligence, 
Form A. Mental ages were computed and used tlirougliouL the study. 

Taulb II —Avkuacil anu VAUiAuiiiirv ok I’l.ueaNTAOKH ok Wf)i{i)H Which Wurb 
C iiASHn'ii:!) uNDi.u Fivn Divihionh ok ii ah Takkn utoM Tiiukb 

IIuNimKi) Twiinty-hix Compohitjonh WuiT'fi,'^ !iY lOniii-n Hum Scituoi, 

SrODIlNTH 



Aiiibnielie rnenn 
of per rents used 
by each iierson 

Ktaiainid 

deviation 

CoofTirient of 
viiiinliility' 

Nouns 

35 2 

2 005 ' 

1 5 9.5 

Verbs 

23 K 

2 024 

11 00 

Modifiors 

14 6 

2 3G0 

10 12 

Connectors 

10 7 

2 003 

U 00 

Articles 

9 6 

2 200 

21 01 


' Cocnicioiit of vaiiability whb found hv tlio forinnlii CV » 


The nmnd moasuio used was a “Sentence Voculnihuy TuhI, ” tleviscd 
by Garrison of State College, Kalcigli, and designed to cover a grade 


TaWIX III.— AvJUIAGES and YAlUAUlIilTY OK MKAHUUBH ok M) Nl'AI. AmiilT\ AND 
Fathhii’h Ocoui'AnoN or l*h<inrY llimi Schooi. KTunijN’i’s 


Measures of mtolligcncc 

Aiilliiiielii* 

meuiiH 

Kliinilurd 

deviutum 

Coollieicnt 

vnuiibility 

Mental ago 

13 75 

1 545 ' 

11 236 

Vocnlnilnry teat 

47 U6 

0 134 

12 702 

Avoiago scliool grades 

83 10 

7 807 

0 395 

Father's occupation ' 

13 08 ! 

2 ()00 

20 5(i5 


range of from thud to eighth ‘ Foi a third ciilorion, the aveiage 
grades in all thought subjects (l^nghsh, luslory, civics, a natuial 
science, and language) made by pupils during the lust tcini of the 
Bchool year 1029 and lOIJO were obtained fioni the lilo in the princiiial’s 

1 Tins toil m inuoh like t)»o Ilolloy Vornhnlary Scale, Init nimh' inoie diflinilt 
An example of the teat is as follows; To pledge m lo . Hctlm' t uhIhoh 
council promise 

A study involving its use may bo foiuid m (lainson, K C , Tlie Uelalioiiship 
between Three Diffcroiit Voenbulary Abilities Joumal of /!,’t/ucnbo»fd Hescarch, 
Jan, 1930 
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office Also for an iiulox of home ciiviionineiU,, the falliei’s occupa¬ 
tion was usGcl and giv(?n n quiintiUitivc lalinp; using the Bair Seale 
Rating of Occupational )StatU9 ‘ A table of tliche indices on p 470. 

It was de-sirable to sue what pari the factor of sex played in the use 
of different parts of apeecli as well as the intelligence ratings. The 


TAnnE IV —CoMPAiuson or 'nin pEurENTAOEH or Du'fetient Pauts or Si’Encii 
Ufl]5i) iiY Eicinn Ilnm Sciroor, Uinr.H and Boyh 



Numlicr: 

Nquuh 

Vcibs 

Moch- 

fiers 

Con- 
1 iiuctois 

Ai tides 

1 

Boys 

30 

34 I) 1 

21 0 



14 3 

Gals 

dl 

3(5 5 1 

23 7 



0 0 


following table shown tliat tliore is, on the wliolo, voiy liLlIo sex differ¬ 
ence in the u.se of the diffounil, parts of spoooh 

It may be seen by the uliovo table that the cluof difference is the 
boys’ and giils’ use of spreoh in niodilioifi and iiitidcs Tlio giiis use 


Tahui V —"Oomi’ahihon or Men'j'al Aoes, VocAmrEAHY Test Hcoimfi,, and 
AVEItMIli iSdllOOE (liuim IlY Si.x 


Boj's 

Girls 















4.9 per cent nioie inodihcis than do the boys, while tlio girls u.se i) 3 
pci cent fcwei ai tides than do t!\e lioys 

Table V compure.s the sexc.s l)y thri'c ol.hci ciitoiia. The mental 
age and vocabulary index of (he boys and girls show very little dilfei- 


‘In tills list oim liiiiKlird ii’pii'si'iilatu’c oi'ciipations, ciirli di’Iiintcly and con¬ 
cretely (loHculicd, iiilcil fujiu (iiic lit one hunilicd hy Unity judges incoidiiiR 
to tho Rriidi) of iiilclIiKCiice wlncli cadi uiiH lidna'cd to di'iiiami Prolinhtc I’lioi 
values wnic eompulcd fin nil Lhcsi' uiui liniidicd oiA.iipntioiis and tlic latings dis- 
tubuted, III till' prcHciit Htudv IIiumc ocenpahons timt wcic not nichnli’d in tlio 
one luindiod listcii in (lie Unit .Scalii wore clasHdn'd as tlic occupations most liko 
them Tlio Biui KoaU' Uivliui'H list is fully dcsi ulicd m Tcmiuuii’s Gciiclic Sludtcs of 
Genius, Vol. I, p. 00 
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once. The girls ouLriinkcd the beys l>y 4.S pc‘r cent lu their average 
school grades 

By way of further analysis, menial age, vociibuhuy tests, average 
school grades and the percentages of the diffoimiL pails of speech Avero 
studied and zci’o Older coeflicicnta were computed to show relation¬ 
ships among these factors. Table VI shows lire various iclntion- 
ships found by this compulation. 


TAitiiK VI — This Hv.i.ation iihTWM.N xiin Dim.wr.NT Paiith op Si’iincJi and 
Muntvt. Adii, Vocahuiahv Tlbt Kcoin.s, ano AvKnA<ni Hcirooi. (inADEs 


Pni ts of flpprch 

1 

Mental ago 

Vocnhulniy 
te.st sr.oro 

AvoraRG school 
Rrftdcs 

Articles' 

6*2 1 

no ! 

4H 1 00 

61 ±- 00 

Connoctord 

20 ± 

07 : 

17 ± 07 

14 i .08 

Verbs 

- 27 J- 

07 

- 17 .h 07 : 

- 22 ± 07 

Modilicrn 

- 10 fc 

08 

- Of) 1 08 

08 1 08 

Nouns 

.09 i 

08 

-. 10 .b 08 

- 00 ± 08 


‘ A conclfttion coofficimt of 30 ± ,07 wag bmiid to o\iHt licLwcen Enghali 
Grades and tlio per ei-iil of arlicU's U8od 


So far na the sample used is concerned, Table VI shows: 

1 The use of the articles a, a/i and ihe, is a licttcr index to mental 
ability than is the use of any other pint of sjieccli. 

2 The use of conncctois next to articles sliows tlie highest positive 
corielntion with meaaurc.a of mental ability, but the cocfncicnts arc 
not liigh. 

3, The use of many veibs indicates lower mental ability witli low 
coe/ficient. 

4, Other parts of speech do not indicato miioli lelalionship with 
the eriteiia of moiital ability used in the .study. 


Table VII—Inteucouhelations bktwiien thu Dippkiihnt Pauth op Speech 
Used in Wiii'I'ten Cumporition hy Eiciiity Hkhi Scitooi. Students 


Parts of speech 

Articles 

; Coniicrtoi'g 

Voilw 

Modilicrn 

Nouns 

Articles 

ConncctoiH ■ 

Vorba 

Modificis 

' 

1 38 1 07 

- 18 J; 081 

- 49 J OB 

40 1 001 

- '22 i 07' 

- 30 1 07 

68 J- ,05 
-.01 ± 08 
01 ± 08 
- 'ib ± 07 
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In the table above may be found a sLutly of the mtcvrclations 
among the usage of rliffei ent parts of speech. 

The study of the intercorrclutions among the different paifcs of 
speech sunimunzcd ni Tal>le VII indicates the following facts con¬ 
cerning compoHitions Hliidied: 

1 Tlic use of a great many words of any single pait of speech, 
resulted in a less or nearly the saiiic lutmbcr of words of another part 
of speech (with tlio exception of ai tides). 

2. The U.SC of arlicles coiiolatCH positively with the use of modifiers, 
nouns, and coniioctora, but ncgalivcly with verbs. 

In Older that the rdatioiiHlup between tlie children’s environment, 
ns measured by occupation, and other attributes might be studied, 
various correlation coeflicicuts botweoii mcftsurea of mental ability 
and the usage of the parts of epocch wore computed. Data me pre¬ 
sented in Table VEIL 


Table VIII — Hdlationsiiip ultwjiln tub Uhd or Auticlbs, CoNNEcrons, 
MouiriniiH, and xim Mkntai. Aini.iTy, VocAmiLAiiv Tdbi' Scouna, Avbhaod 
H cnooi. (fUADUK AND IVniiut’s Occupation 


Articles 

CoJItIM* 

torn 

Mvdiners 

i 1 

Mcntnl 

BRO 

Vwnbu* 1 

Inry lest | 

AvorRRD 

snboo) 

ftrftdcB 

rmlior'a 

OOQU- 
^ pntion 

Articles 

Ccniiactora 

ModiCerc 

MontM aeo 

Vooabuinry lent 

Avo 60 I 100 I erndca 
Fnllicr's ocoiipnlioii 

ns ± 07 

.1(1 1 07 
'li \ 07 

f.2 1 00 
120 1 07 
- 10 1 07 

AR J; Oil 
17 J 07 
- on i 08 
r>s i i)r> 

Ri i on 
11 h os 
08 ± 08 
27 i 07 

40 ± no 

32 ± 07 
02 t 08 
06 ± 08 
21 ± 07 
30 ± 00 
01 ± 08 


The (lata piesontcd iu Talilo VIII corroboiatcs many other studies 
that have found high mental ages nssoeiatcd witli high vocabulaiy 
test scoies and school giadcs. TJio table also indicates the following 

1 father’s Occupation as lalcd by the Barr Seale Ilalinga of 
Occupational Status^ previously icfcrrod to, correlates positively 
with the use of avLiclos, ivlucli la Iho liest meiisuio of mtclligcnco so 
far as pails of Hpcceli aio (ioiK^orned 

2 Vather's Ocoupal.ioiuil Ilatiiiga coiidnto iio.sitively and signif¬ 
icantly with mental age and voeahulaiy te.st scorea As heio rated, 
father's occupaLion does not wein to mfluence school guulos 


‘ Sco footnote 1, j) d7I 
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By wny of conclusion \i may bo Hlalod that: 

1. It la (liflioult lo ex[>lain tlic coiii'latKJii IxM-wccu the mcasiucs of 
mental ability tiiul Lhi* Uho of aiticloH. The corrolalion coofTicient 
bctwcoii the pcrcontaRO of avtioles used ami uumUiiI was 52 ± .06, 
Ijetwcon the porcentago of artiolca ami Iho vmuilnilary tc,st scoie, 
.48 ± .06; iukI between the peiceiiliiKe (if artielort luul avoiuKO acliool 
giadcs, .51 ± .00. 8incc their ih not Iho eiuinco of using articles 
lucoricctly that then' is witli mo.st otluu parts of apoi’ch, such ns 
general modifici'H, llio peieontuKi' of aitieleH usihI iiiiikes a lioller index 
of mental ability. TIiib is especially trim in view of tliu fact that the 
cou'cliitioii coeflicieiUs between iiieiisures of lumiinl ability and the 
use of aiticle.s nro m most cases higher than ooiielation cooflicients 
between the diffcient ineasuics of ineiUal ability thoinsnlvcs The 
only exception to this is the corielalion liotweiui vocabulary test 
scores and mental ages, 158 ± .05, wliile llie coofiicnmt lietween mental 
ago and the use of lulicloh is ,52 + 1)6. 

2 The positive correlations between the use of cnniicclors and 
mental ability would bo easier to ovpinin than that of articles with 
mental ability, if one assumed that the iir.st part of a Hmilence had to 
be kept in iiund while the lust part was lieing coinposml. The oorre- 
latioii coelRcicnt between peieenlugo of connecLoia and inmUal age 
was .20 ± .07, between percenLago of connectoi'.s and vocabulary 
test scores, 17 + .07, and between percentage of connocLois and 
average school grades, .14 -± ,08. 

3 As would bo expected in any flliuctine, the jiarlH of winch aie 
as inieidcpciulcnl and constant as the pails of a sentence, an increase 
in the use of one part of speech will iiutoinuticully be accompanied by 
a decrease iri the u.se of tlic othci pails of speech T'lns holds true 
for nil parts of speech except nrhcles. Since articles aie so closely 
related with nouns and modihciB, positive couelatioiis would be 
expected between articles and these puits of spceoh, and such relation¬ 
ships actually exist 

4. The use of aitides luia alinoat us imicli idalionsliip with occu¬ 
pational status as has vocabulary alnlily as i(3pioheutod by the vocabu- 
laiy test scoics—the foimcrrchiLion being lepresontod by th(5 coircla- 
Lion cocfTicicnt ,39 ± .06, and the latter, .32 :1 07 (Children’s 
onviroiiincnt and possibly heredity, as rcpro.sented by tlio occupational 
ratings seems to influcnco the montal ability ns loprasoiitod by tlic 
meutal age and vocabulary test scores, and at the saino time their 
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use of ai tides. .School Rradoa arc not signiacanily influenced by 
parent’s occupation in thia study. 

5 A thoioughly quantitative method of measuring the correct 
and mcoircct usages of dilfmout parts of apccch, rather than the study 
of porceiitagoa of Avords clnaHified as lioing cortiun parts of speech, 
would probably throw new light on tlin aubjecL of the idation between 
use of diflcient iiavta of npeech ainl mental ability. It ih hoped tliat 
such a method ciin be developed uinl appln'd. 



falsification of AOK: a factor in child 

(RJIDANCK' 

ANNA COHEN AND NATHAN ALTlU)\Vn7, 

Psychiatric yocml AVorkcra, Child (Uiiflniuc Drimrltnpul, II(‘l)r('W .SltoUering 
CUuinlinu Hocipty, Plc‘B‘»anlvillo, N Y. 

Tho wntors hiivc recently had Uio Rood forliiiK* to coopernle m the 
handling of a enso iiivolvjiig a factor jii cliild giiKhinco which la often 
obsGuicdj it is that of falsificiition of age* 'I’lim appartintly harmless 
not may result in inminicrnblo conllicls whicli give rise to abnormal¬ 
ities in the development of a personality 

Our iijstance is that of n boy who wna committed to tho institution 
as unmaimgGablc He is an illcgitiniale child wliosc mother is con¬ 
sidered neurotic. The Imy was hoin in a distant city, and the putative 
father deaerted almost at once. Aflci moving to her piescnt residence, 
the mother marriecl a man Avho ih a di mikard The inotlmr rcpcntcclly 
told the boy that ho must help her and his younger brothoi; that he 
was really hor mainstay becauso of the meapacity and worthlessness of 
the stepfather. Tho boy was jealous of Iuh brother, yet ho took a 
serious big-brotherly intcioHtin him, lie quarreled withhiHstcpfathcr, 
wrts disobedient, and wilful. Ho was also known to steal frequently. 
When lie arrived at tho institution, ho continued to react in much the 
same manner for a long time. In order Ihnl he iiughL sooner take over 
the responsibilities of the home, lus inollior had niado him bohove that 
ho was two years older than she thought he was She explained her 
placing him at the institution nt the lower age by saying Hint only by 
doing this could aho got the institution to care for luni longer and so 
make it possible for lior to provide at least for her younger son and 
herself. 

Thus tho boy was ofRcinlly considered as old as his mother supposed 
liim to be. That even this official ago was incoirect will be secri latci, 
though whether the mother lieisclf did not know oi would not reveal 
his correct ago cannot be determined 

His maladjustment at the m.stitution rcauUod in his lunng placed 
under the care of the nhikl Giuduiico Dopaitmeiit. The workers 

‘Tlio writers wish to oxpicss Ihoir ftppiormlion to Dr Looli W GoUlrjcli, 
Ejceoutivo Direotoi'; Dr Hfiimifll Z. Oigel, PHyeliialiist, Miss Jiilin. (iolclinan, Hrntl 
Psyohiati'io Worker; and Mr Myron B BInneliaril, Pflyclutilius .Social Woikcr, 
all of tlio insktiition roforred to in tins paper, for tlmir kuid migRrsLions concerning 
the article 
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noticed thnt there wus 11 worried and aomewhat resentful look on bis 
face, his step was heavy and Ins head sagBetl At school, he was con¬ 
sidered a poor siudont, doiiiK little work, and coming tardy froqnontly. 
But the social aspect nf the pioblom was even more serious He stole, 
hed, quaireled, was diKobediont and did not usually minglo or play 
with tho other clnUhen, He eHuhiled gieal glee at Iuh success in 
appropriating the posscsHiona of others without hemg caught, and if 
ho wore found out, he did not heoiu to mind. 

Since ilioio was a conilict Between the figuics foi the ago as his 
mothei had irnpiessed it on him iiiul the age as found inthoinstitution's 
records, the workers commumcated with the authorities at his birth¬ 
place. It wa 5 learned tlmtlie was even n year younger than his mother 
supposed, that is, three ycnia younger than he had coine to believe 
himself to bo 

The boy was iiifonncd of his correct age, and giadiially a marked 
change was noticed. lie said that he no longer felt physically Infenor 
to other boys as formerly. IIw cntiio mem has become more carefico; 
his head is hold liigiior, his step is lightei, and he runs and plays with 
the others, He also feels that he is not letardcil m school, since ho js 
in the proper grade for his ugc Ilm iiUitude toward scliool has 
changed; he makes it a point never to be tardy, takes a Icoon interest in 
his school woilc and ih having no difficulty with it, Improvement is 
also noticeable in his social adiUHtineni. He no longer steals, nor is ho 
disobedient, and he seldom quaii'cls 

This description iiulioales that hcic at least is one cause of problems 
that can bo dealt with dnootly, quickly, and adequately. It empha- 
sizos tho sigiiificanco of the apparently trivial inatloi of giving an 
incorrect age to ill tain Home special end without taking into con¬ 
sideration the fact that its lotiil clToct on the jicisonaUty may be very 
far 1 caching. 

Yet how often, for example, do the paicnbs, misleading the authoii- 
tics, stmt the child m school bofoio lie bus roaeliod the propei age'^ 
The causes of falsification of a child'.s age wwy Tliose who are 
responsible for such an act mo generally motivated by one or more of 
several dcfiinLc factois 

The mothei may have 110 time to emc for llio child, slie may liavo 
to go out to cam a living, or she may have a younger child to take caiG 
of. On tho Gtlicr hand, llio clnhl may have been imwantcd lie may 
be au illcgiUmatft child, whose illogitimncy will not lie auspeoted after 
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tho ago has boon falsifici) Onen this is <U)nn, IhcMc flovrlop problems 
that are difUcult o£ snkuion. 

First of till, tlio elnUl is foifoil into HiluutuJiis Ihal lie is too young 
to meet Imagine tho rimroiiingiiig and iiKncmli/iiiig olTi'ct of constant 
defeat in athletics in eoinpefilioii with iniirli bigger Iioj'h of his pur¬ 
ported age- It IhiUh I lie oliild'h play life and (cikIh to make him 
scclusivG 

Second, it lequires (luit. Clu* cliil<( live up to I wo divergent standards 
of bcliavior, one at home and one at school. Ho iheie develops in his 
mind a conliiot as to which one lie ia e\p<'cle<l to uphold. 

Third, it lames the child fioin one aoeial R(at,UH to anollier without 
adexiuivlc propavatiou. At the time when he hUouUI bo looking 
foiwanl to comjiloting 1 iih education, lie is placed in llic position of 
breadwiimri. The chiUI therefore fenln deep cone-ern over his failure 
to gam the iiaining neeessaiy to make Inin capable of slioiildering these 
responsibilities 

Tlio coiribined effect of all these fiictoivs, iiiipressi'd uimii the glowing 
child may eventually turn him mto a serioiiK piolihuii. 

Tho .soliiUon of the difliciilty must neeessiinly he in tho letiirn of 
Llie child into the family situation at his eonecl age willi I he slandaids 
suitaldo for that ago. 

NoTbi —Since the purpobo of this piipi'r w lo iiresent the. problem of 
age falsification per se, no attempt has been made to givi' the analytical 
interpretations iliat would be involved in coiniileting tho jncUire of the 
case 



NEW PUBLICATIONS IN EDUCATIONAL 
PSYCHOLOGY AND RELATED FIELDS OF 
EDUCATION 

CONJ)UCTIOD IJY iaiANCE.g M FOSTER 


Adolescent Educnlion, by Ficidcuok J'l. EoKoi\. Now Yoik: The 

Macmillan Company, 1931. Pp. 500. 

It IS perhaps no o.\ap:(;m'alion lo say that tlioio is no other field of 
education conoeiinng winch moie .scioiitific knowloclKO is needed, and 
less IS available, than m the fichl of adolescent education. There has 
been a dearth of bcknitido lUeiat.iirc prodiiccd in this hold during the 
past fifteen yoais 

"Adolescent Kducalion" by Piof(“<Hor Frodoiick K Bolton will 
moot a long felt need in this pailicular lield. The (‘ducalional world 
apparently has not fully leeovcied fiom tho loss Hustaiiiod by tho 
departure of (lint leniarkivble hludenl-, leachor and educator to whoso 
memory Profensoi Ilolloii 1ms (hslieated tins book. 

Tl\o anthoi btaten tlmt the book is inte,n<lod to bo an analysiB and 
inventory of the adok’seent for (ho purpose of finding his potentmlitiee 
and his needs as dolerniined liy bm imfoldmenl Tho courso of sLudy 
is treated only ineidentiilly and only as n means to an ond Tho 
author tolls us that liusiin'ss, sooial and economic conditions and 
traditions have boon tho (vluoiilional (loleiniinantH, and tluiL tlic cdu- 
oationni theorist-, not trained in ii.syeliologienl aimlysi.s proceeds with 
what ho conceives lo be the logical nnfoldinent of the subjects and 
arrange.', the lra<litioiml sohool subjects into what ho coneoivcs to bo 
ideal “incntal discipline " 

The ehiki psychologist, iubteiul of seeming his basic information 
from iiuhistiies and ihe woild at huge, endeavors to secuie his infor¬ 
mation directly fioiu the chdflien 'J’his pioccduie consists, perhaps 
finst of all, of a thoiougli seienlific analysi.s of tho child's physical 
equipment, accomiuuned by a thoioogU luul hcieuUlic nnulysia of lua 
instinctive tomleiicie.a, In.s inoiifal ('(impnieiit, and has interesla all of 
which serve as a key to the kinds of activity be.st mnled lo the pioper 
dcvelopirK'iit of the eliihl 

Piofcssor Ilolloii points onl. the often unolisoived fact that a scicii- 
tific educational pioeeduiu builds upon what is, in oulei to achieve 

170 
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what is io be. This necesHitalca a Hcieiilific niul funolional knowledge 
of tho pre-adolesconl, adoloscnnt ami tlio post-iulolescent life of the 
chlkl Professor Bolton’s book conmstH of sKteen oluipfcojs each giving 
a ecicntific troaLnicnt of a fuiulniiiental aspect of ndolescnnt education, 
Tho book rovcnlB a innstery of the scientific bleTiiture in ilsfiekl Bach 
chapter is accompanied by a caiefiiHy HcU'clpd bibliography. The 
book concludes with n thoiougliaiulcnlightNiiiig treuinient of tho ever 
present and gigantic problem of CJliauicler iMlucafum. 

Dknnih (y, Thoth. 

Ponnsylvania Stale College. 


A COllllECTION 

Editor, Tins Jouhnal op Kdocationai. PHVcriOLOOY. 

Deni Sir; 

Theio is an ciror (of transcription) m my foiimila in the aiticle, 
"The Sigmas of Combined Dislubutions ('ulculiitecl fiom Sigmas, 
Means, and Frequencies of Componont Distributions," in the April 
issue of Tun JouimAo, In Formula?, page 310, Iho sccoikI term of the 
left-hand niGinbcr ropicsenting the combined in(Min Blioiild be squared 
This evi'or was discovered by Doctor Louis W. Gollenminn. I am 
also indebted to Doctor Harry Ilclfion for reporting difficulty with the 
formula aa it was printed. 

Tho correct form of the formula is' 

W + -b -b . W "H VWn 

iVi + A»+ ■ N, .. 


/(xi)N\ -f -b 

* ■ (Xt,)^n\ 

\ 4- i^s + 

■ N, 1 


Yale University 


C. 11 Garvey, 




THE JOURNAL OF 

Educational Psychology 


Volurao XXII Oclohcr, 1931 Nuitibcr 7 

ONE MORE STUDY OF PEllMANICNCE OF INTEREST* 
IIAIIVEY 0 LEHMAN 
Ohio UinvGiBily 

AMD 

HAUL A. Wl’n'Y 
Northwoatcrn Umvorsity 

Tlio question of poiinjiiioneo of vocationa] interest is obviously of 
utmost imporliinoo to tlioso conceinod with problems of personnel 
and guidance. If giiularioe bo based upon a iiujiil’s tissumod occu¬ 
pational intovcat, ami if this aHMunwl inlercBt proves subsequently to 
have been merely a passniK fancy or ii. teinpoiaiy whim, the outcome 
of course will bo wasteful and Iho pructioc mjudioioua. Obviously the 
question of tho degice of iiernianence of mlcrest la one of great 
individiml and social Higiufieanco. 

In order to ascertain tlio ovtent and degree of permanciico of 
vocational interest, the wutoiH adininiBloied tho Lnlunan Vocational 
Attitude Quiz to a laigo number of scliool childicn m Topeka, Kansas, 
and in Kansas City, Missomi t 

The Vocational Attitude (iui/. consists of a cQUipieliGnsivc and 
catholic list of two lunidied occupations. Fust, the childicn are 
asked to chock onlu those oecupalions iii which they arc willing to 
engage as life woik. They me then asked to indicate. (1) The llirec 
occupations wlucli they would like best to follow, (2) tho one occupa¬ 
tion which they most likely will follow, (3) the three occupations wliioh 

• Tho preHont tttiiily pri'HPnla hdiho lindmKH tlml hnvo born mmlo pimblo by a 
grnnt-m-niil from Iho Hocml Hcipiht Um'iirdi OMinnl 

t Tho wrilfira nro iiulobtud to Mias Aniui (J Myer«, Mr. J F Kaho, filiporin- 
tendervt A. J Rtout, ami Hiq>erii>tcndvut ttfoigo A Melchor for aHsiatanco m 
securing tlicac data. 
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they think arc the licst moncy-nmkcrH, (1) tlic thu'c occupations 
whicli they boHovo arc most iCBpccttnl, unil (6) llio tliico occupations 
which they believe will require the leuHt uiiiouiil of eftort The 
numboi of childicn fiom whom clulii woie ohtiiiiuMl ih inclicaled m 
Table I. 


TahLE I — TotaE NuMIIKU of Is( I.WIIFDIN a .Hi HIJ.H of iNVkbTIOATIONB 

OF C^lin.DUrs’H VOCATIONAl. ArriTIIDlH 







KniiFAfl Gilyi 

KnnuaH City, 

Kansas CUy, 


Topoka, 


Nevriiiber, 

Nov(‘nihf'r, 

November, 


Oclohor, 

HnMfM 

1028 

[siipp- 

102K (mfiTior 


Ages 


' 



rcoiioiiiK' 







10 HlnlUB) 

HlatUh) 

fltntus) 


Boys 

Girls 

Boys 1 

Girls 

Bujh j 

Girls 

Bojs 

tlulH 

Iktys 

Girla 

8H 

203 

259 

82 

101 

137 

IKO 


174 

304 

324 


340 

358 

257 

274 

212 

211 

182 


342 

369 

loH 

403 

372 

347 

340 

201 

238 

23(1 

222 


436 

ilM 

387 

376 

386 

365 

260 

272 

253 

228 

360 

377 

12H 

392 

372 

420 

337 

331 

320 

209 

200 


332 

m 

305 


3G3 

378 

373 

317 

236 

222 

262 

298 

14H 

301 

301 

352 

320 


345 

109 

104 

Ha 

282 

15H 

324 

322 

28G 

343 


306 

132 

IKl 

Kl 

241 

m 

2C1 

200 

230 

201 

248 

217 


06 

172 

107 

17}4 

102 

150 


171 

132 

111 

40 

37 


96 

IBH 

67 

30 


44 

48 

33 

13 

7 

<13 

19 

Totals 

3264 

3280 

2008 

2033 

2680 

2666 

1706 

1799 

2773 

2969 


Total boys 13,340 

Total eirla 13,032 


Grand total 20,878 


Table II prcsculs the ortiei of inont (lauk frequency) of occupations 
in which boys 8^ to 18}i years of ago staled that they would be ioilhng 
to engage. Tablo III picsents tho lank of occupalions hied best oi 
preferred most by tho boys 8^^ to years of age. 

Table 11 is to bo read as follows: ‘'Aviator’’ is the one occupation 
that was most frequently checked l)y hoys of 11).^ to years of 
ngc as tho occupation in which they would bo willinR to engage as a 
life work. This activity ranked sixth for boys 8j.^, Lliird for the boys 
years of ago, and second for the boys of 10}.^ years of ago. A blank 
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space in the table indicates tliat fcho paiticular occupation was men¬ 
tioned by an oxccetiingly amall percentage of pupils, and a rank 
tlierefoic wiia not nssigned Tables II and III show the lank only of 
the most frequently mentioned occupations for each age group 


Tahlb II —Hank in Pin quiiNoy i)K Occur ationh xn Wincii Boys ok to 18}4 
Ykaiih ok Aon Wowi.b Hk Wiixivo to ENtiAon 









Arps 





No 

Occupnltiins 

1 









- 

-- 



K'SjOVb 

10'i 

ll'i, 

VIH 

13‘$ 

UJfi 

lOH 

10>j 


mi 

i 

Aviftlor 

U 

1 

2 

1 

1 

1 

1 

1 

1 

1 

1 

81 

CwU onKincer 


2« 

iSw 

IH 

10 

H 

3 

1 

2 

4 

2 

18 

/rohiloot 




.3U 

27 

in 

7 

4 

8 

3 

3 

83 

Blcelncuin or cloriricnl ptiRiticor 



J7 

2K 

18 

12 

0 

3 

4 

2 

4 

100 

Cowboy 

1 

1 

1 

2 

2 

2 

11 

33 

35 



30 

Sflilor 

2 

A 

3 

6 

7 

16 

21 

20 

38 



33 

Army ofllt'cr 

3 

S 

0 

i 

6 

8 

17 

m 

16 

18 

18 

34 

Soldier 

1 

4 

4 

0 

11 

22 

30 





110 

ShcrifT or puliroiimii 

R 

7 

10 

12 

23 

•J1 






70 

Professional linselmll playtr 

7 

0 

6 

3 

3 

1 

r> 

It 

11 

12 

20 

07 

Jookoy or mitoinoluln rftf<r 

H 

K 

N 

7 

K 

13 

14 

13 

m 

26 

27 

"2 

8lup builder 

U 

II 

D 

23 

33 







74 

Fireman or crRincer «m n trom 

10 

11 

n 

10 

13 

11 

10 

10 

20 

81 


102 

FiiherinAn, liuiilor, <ir Irtippi'r 

II 

11 

11 

13 

16 

IK 

16 
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Those of equal frciiucncy arc given the sairic ninlc but, contiaiy to the 
usual custom, uinkH me uniiUed in iiiHtuiices in which few or no boys 
checked the oecupivlion 

Certain of llie frequency ninlcH cliiuigo inuikedly with advance in 
chronological age. Foi eMunplo, in 'J'nblc II the tlnid item from the 
top of the hat is “ Archilecl.” This occupation was laicly chocked 
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by young cliiklion, bul lit ugi*8 IG*^ to 'vuh cliockoc] frequently 

and thcicforo icccMvcd rank (href 

In Table HI, tlic wcond ilom ih “Ojwboy " Tina occupation 
receives rank one til nges H}-^ and 03i* Ibo upiier age levels of 
course this occupiitioii rtuika very low. The fiudingH Cor Uus occupa- 
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lion are portrayed clearly m Fig 1 and Table IV winch proHcnt the 
percentage of live gtoupa of wlulo boyn of vurious tigt's wlio assorted 
that they would bo willing lo bcconio cowboys. 11 will be noted from 
Fig. 1 and Table IV that the rnnlcB mo udatively eonsiHtcnt at the 
several early ago levels. Nevertheless, it is clear also that peimanoncc 
of interest in this particular vocation la decidedly lacking. 
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The wiitcrs Imve asspinblod, siimlaily* tkUa for all tl\c occupations 
of the cliock-IiBt which woio n'portctl by the children as ones which 
they would be wilhiiR to enter At . 1^0 8i^ the average number 
checked by the boys was ‘2H.8; at urc the average was 15,6. 

Since tlie number of occiipiUionH in which boys may engage is exceed¬ 
ingly largo, the pcrccntagea for ottch of the many occupations are 



Fio 1.—Por coiitH of Hvo groni>n of whilo lioyB of vnrioiiK ngo lovcla who exproHsod 
villinKttriiii lu hccomo "Cowboys " 

-Tojiokti, Ocl, 1027 

-Topokii. Mity, 102s 

-KnnwxB t liy. Mo, Nov , (5>upottQt oconoinio atatua') 

-Kiuisus City, Mo , Nov , 102S (Inferior ooonomio Htntue) 

—--Kniisns City, Mo, No'., 1028 (Avorngo ocoiiomio stfitus) 


small. Because of this fact, the dula showing jiorccntages foi each 
age level do not portray vividly the sinking ehunges m attitudes that 
really lake place; (lotn ynii to year. A caicfiil sLiidy nf the data 
suggests however that pennaiienri* of interest doe.s not c\i8l in many 
or oven most of the vociilionul pieferiMiees of hoys Indeed, from 
examination of the ranks of the occupations at diffeient ago levels, 
the writers have been foiceil to conclude that peibaps no phase of 
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human nature la aubject la aiirh iimrki'd chmigo uh lhal ronocted In the 
vocational mteroblH and pruh'iuncuH of RrtnvinK boyn. 'fins conclusion 
differs strikingly fioin that exproshod iiy niinimmis woikors of the 
past and by sovciul prchcnt-day ones 

Among the cnrhcHt sUidio» of peiniatioiioe of inlcrcsl were those 
of ThornclIkG,* Thorntlikn concluded Hint it would bo haul to find 
“any feature of a liinnnu being which was a nuieli niore pormnnont 
fad of hi3 nature than lii« loliiUve dogroca of inImoHt m different 
linea of thought and action" (P *15(1)‘ Ho coududod also thnt 


Tadi.b IY.—IbiaCJiNTAOB 01^ Fivb CiuoufH OF WnriE Uovh of Vaiuous Aqb 
Levbi/8 Who ExvuEftHBU Wti.i<iMunKKH to ilEcoMC “Cownoxs” 
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interest and ability arc so closely bound togotlicr that “either may be 
used as a symptom of the other almost as well as for itsoU." (P. 456 )* 
Several writers interpreted Thorndike's conclusions as implying 
that children's vocational ambitions arc relatively pcM’manent and 
that vocational ambition is a suitable index of vocational ability 
In 1922, Freyd wrote icgarding Thorndike’s woik: “Tho metliods used 
were such as to make tcbuHs of limited signliicunco yet in thoir field 
these results are practically all that aro aviiilablo ” (P. 244,)^ 
Several writers seem to regard Thorncliko’fl former pronouncoinenlsand 
tho subsequent gcnoralizataoiis of other wntcis as valid when they nic 
applied to children today. Moreover, Iheio are many attempts to 
verify the basic theses Books and articles arc now being published 
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which present cvulcnco of a continuance of intor(‘.sts for a few months or 
a single year ns proof tliat huch alleged vocalioiml interests are sympto¬ 
matic of permanent mleieslH Fianklin reports data obtained fiom 
gome fifteen hundred jumm high .school pupils of nalUmoie who woie 
asked in Dcccntbei, 11)22 to nain(‘ Die occupation tliat they would like 
best to enter h'ollow-up fpK'.sl lonnaiicH weio filled out in May, 1923, 
Octobei, 1923, and DeeenilK'r, 1023. The following conclusions wore 
expressed 

Tho vocat-ioiiiil mleii'Hls of junior IiikIi kiOiooI pupils hIiow a very high dogreo 
of pcrmonpricc ovor u p''>»>il of ot leasl oni' yciir,—niid that a very critical ono 
Two children out of every lhi<’(‘ htwo tho huiiu! [iroforciico at llic cud of the period 

as they had at the hcguuiing (P 165 )» 

McCracken and Laiuh lepovt a senes of Ktudies that were made in 
Denver March 1, 192(1, May 2r), 1920, and in Apiil, 1021. The 
problem of peimanenco of inloieHt was btudierl foi a period Im than 
three months t» knglh. 

Of i'181 junior and honior liigli-school MludoiilH witoso choices were recorded 
for March 1, 1020, and NTay 20, 1020, with the mlorvonmg time nearly throe 
months, 73.0 per ('(>nl of the boys niiil 70 S ])rr coat of the* girls ohoso tlio samo 
oooupalion on both urcnsions * 

The oicdulouH veador m infminetl that "Theso choicos, although 
made so close together, do indicate boine pennancncy ” (P 43.)^ 

It will he of inteiest at tliiH point to examine Fig. 1. If the hues 
of this graph icpresont the Hitiiation as it will exist fioni year to yeai 
it may bo as-serted that a very large peicentugo of the boys of a given 
age wlio are willing to become cowlioys will continue to cling to this 
notion three months luiiice,-- oi even a year hence. To this extent, 
these data corioborato lliosi* of Fianklin, and those of McCracken and 
Lamb. It is clear, however, that oier a longci pci lod of lime, a pei- 
raancncc of interest would not lie found It thcicforc seems invalid 
to base concluaioim regarding peinianeiioe of vocational intcicst upon 
a study that conlinues oidy foi a few months o) foi a yciv 

The writciH have ultaiiki'd the problem of pcriiumencc of interest 
ill a somewhat difTeient maniioi 'I'lii'y have Htuilied the vocational 
mtorests of seveiul tlimiHand cliildieii of ages Sj ^ The 

writers are heie assuming lliat (he piestud 8' ^-yeai-old chilclien would 
lespond next year as do (,h<> 9^2-yeai-old ones, etc The validity of 
this as.sunii)lion they aio nt (lie pie.seiit lime invoaligalmg Scveiiil 
follow-up atudios are under way (o tesl. tho reliability of the children’s 
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reports. Ncvertlicicsa, it BroiUB IokicoI to luwinnc that groups of 
8 H"yGW-oId oliildron will respond next year as do clnldron now Oj^ 
years old provided that the children live ui a eonservativo city, not 
affected appreciably by a uhifting iiopululion If Die wiitton expres¬ 
sion of wilimgncHs (and intention) to enter a given vocation bo regarded 
as cxpreBsion of interest, it is obvious tliat iiiimy of lli(‘ inteiests of tho 
children heroin studied cannot bo regaided us permanent ahico many 
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Fia. 2,—Por conU of fivo groups of boys who slnled llint thoy cxijpctocl to ontop ono 
of tho following types of oiigmoorfagt^ohoinical, oivil, olcclncnl, inccliniiionl, or mining 


interests of the chiklion change inaikcdly duiing a penotl of several 
years. 

It will bo of interest to examine the liypothesis that intcroBls are 
symptomatic of ability, Ability is sonieliineH conceived as inlioront 
capacity; inboiii and unchangeable. If Huh conceiiL bo adliorod to, 
tho hypothesis that interests arc syniploinalic of ability poslulatca the 
additional hypothoBis that mlorosls do not cliange markedly The 
data herein presented reveal that certain of tho cliildicn's iiitorests 
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change markedly cluriiiK a period of sevcial years If ability be 
conceived ti3 inborn und predelmnined, it is clear tlmt the childrcii'a 
mteiesLs can not bo conHidcrod n*liablo indices of tlioir abilities 

Figuio 2 hIiows the percnntngn of the five groups of boys who 
stated that then expeUed to enter one of the following forms of 
engineering. Choinical, oivil^ eleclncul, nioclinnical, and mining. The 
United SlatoH census report shows Ihiil in 1920 these live groups of 
engineers included only l?ir),789 while jicrsons. According to the 
census report there were, in the TJniled Slates in 1920, 29,053,677 white 
males of ten years of agti and almvc who were gainfully employed. 
Of this number the five enginporing gioups listed above comprised 
less than onc-half of one i)rr cent (0 10 pei cent) If the latio between 
the number of eugineerH and the total nvunber of other gainfully 
employed white niale.s continupa to remain similar to the 1920 condi¬ 
tion, it 18 clear that no ag(* group can coulrihuto many members to the 
five engineering groiipn ))reviouHly ineutionod. Figure 2 shows 
that 26.6 per cent of the 17^^-ycur-old boys stale that they exyecl to 
enter engitiecnng. Of eoursi* one inusL bear in mind that many of the 
less competent boys have hern rliiniiintpd from school by the time 
ago 17J^ is reached It is also well lo bear in mind that these are 
city boys having unusual educntiomil advantages. After duo allow¬ 
ance has been made for Huch faeis a.s these, one can scarcely conceive 
of the demand for engmeer.4 incKaising sufiicirntly to absorb so many 
youthful aapiranls 

The Vocational Attitude Quiz included forty professional oiideav- 
ora. Figure 3 prc.seiUs the peiconlago of the five groups of boys who 
stated tliat tliey expected to entet IheRc forty profeasioiiB The per¬ 
centage variG.y fiom 21 to 50 iit the various ages. According to the 
U. S. census leport, these foity piofessions included in 1920 only 3.16 
per cent of the total numbei of while males of age ton and above who 
were gainfully employed. Thoi(‘ is of coui.se no valid reason for 
believing that the* 1020 ratio la to exist indefinitely. On the other 
hand, it is imposaiblo to believe that over fifty per cent of the 141^- 
ycar-old boys will have the oppoitumly to enter the professions It is 
more likely that only a Hinall proporlion of Iheso boys will be able to 
And a place ni tln‘ pr()feH.sionH and a still Hinuller iiroportion will enter 
upon the pailiouhir luofi'Hsioii which at age 11)^ they expeol to entci. 

The situation for I he girln of vai iouh age levels wlio stated that they 
expected lo become (^lenogrnpherH in fjyp/s'f*} Ih Hinulai Lo that of the boys. 
Figure 4 shows that ovei thirty per eent of the IKt-^-year-old girls 
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oxpresBod tins vocational closire. 'I’ho U. S, censUH report bIiowb that 
m 1920 tlio wliito fornaio stenographorsj and typistn (.')G2,6G4) included 
only 0 8 per cent of the white loinnlo workers (6,002,210) of ages ten 
and above. 

As a pioneer in tho field of vocational and educational guidance, 
Thorndike is entitled to the respect, of all Nevertheless, Thorndike 
would insist, the writers believe, that hia data and ooncluaions be 
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Fia. 3.—per conts of flvo groupa of hoya who atalod that thoy oxpooLccl to ontor one 

ot lolly pTofcRUonB 


verified. Certainly, in a country in which social attitudes and values 
arc flubjcct to such reactionary and sporadic fluctuation, it is essential 
that behavior data be stasemblcd repeatedly to show important tTCnds 
and socially significant changes. It is, however, ddricult for us to 
modify attitudes which have been generally accepted. Striking indeed 
is tho domination of outgrown, Impolont, and socially undesirable 
determiners of conduct. 

The obstacles to psychological advance include not only factors 
such as inadequate methodology, social taboo, etc Psychology is 
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held back also by a mmIous facloi which is not fr(3qiiently mentioned. 
Once an onoi has oiept into psychological litemturo, it often requires 
the labor of Bovoi'al genoriUions to modify or to dislodge it. At some 
future date it will be of inlcn-st to Rludenlu of paycliology to trace 
numerous generally accepted piosent-day miRcouooptionH and raUonal- 
izationa At thal I line it ih liiglily probable that many of Iho 
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Fia 4,—Por contfl of itvo Rrounn of kitIa wlio Blntcri thnt llioy ox])octDd to bocomo 

atGiioRrniilipra or typiBis, 


studies of peminncnce of vocational mlciosl will bo cited ns splendid 
examples of tlio inadeciuaey of tlie rotiospcclive ineLlioil for identifying 
interest 

The data nRSoinbliMl by tlio wnlns indicate llmt. eei lam vocational 
inteicsts cannot lie perinuneiil. (Hee I’lgs 2, d, and 4 ) Other 
intoicsts may be inoie peiniaiient. And availalilo <lata show quite 
clearly tiial interoHlH arc Byinploinalic of ability only to a hniiLcd 
degree 
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mieror reading as a method or analyzing 
factors involved in word perception* 

Mn.ES A TINKER AND FLORENCE L CiOODENOUGH 


ITiuvcrfliiv of Minncfiota 


This study wii« luuhutjikon foi the puipuso of ascerltuning to what 
Gxlcnt fcho natuio niui fi(‘(pioney of the erioiB made in learning to road 
aloud English proHO luatenul in Ihc reversed position as shown in a 
mirror iniglit tliiow light upon the pncepLiml pioccssos of ordinary 
reading Four adult HUhjeelH, one man nml three women, none of 
whom had had provioua formal experience with minor reading, 
participated in the expoi-imont, Tlie subjects worked in pairs, one 
reading aloud while the other acted as iccorder and timekeeper A 
rootangular mirror eight by t(*u inches was used. In the initial 
stages of the oxporiuK'nt the minor was Iield in an upiight position by 
the recorder; but as tliis was found to lie soinowliat ineonvoniont for 
both persons, a support was dovihod which hold the mirror at a constant 
angle of onc-hundied degrees with the toj) of the table. Eacli reader 
hold the linok himself and adpwled its dislnncc from the mirror accord¬ 
ing to his own prcfeionee. 

In taking the record, the recorder occupied a i)OHition facing the 
reader who licld the book wjlJi its back towards iiimsolf and llie pages 
facing both the minor and the lecoidei. In lliiH way the subject was 
able to lead from the iniiror, while the lecoidor followed the text 
directly and made note of each eiior uw it occuiicd A prepared foim 
was used for this purpov*. At theoml of leu mnmic.s, which was timed 
with a slop wateli, tlio siKual lo slop was given and n, rccoid was made 
of the total numlKM of woids kukI iiud the number of errors 
made Tins included errois which were spontaneously corrected 
by the subject as well as those which passed unnoticed or at least 
without collection. 

Rending was earned on for ten iiiimites daily duiing the period from 
April 4-July 31. At Huh lime the HUinmci vacation intervened, and 
practice was suspended until SepliMiiiici 25 when it was again resumed 
and continued until November I Save for occasional unavoidable 
omissions, piacLice Look place seven days a week (luring those periods 

* Qratoful awkaowledgjuent)« due l« Di Mary HJjirJoy wJio served as subject; 
throughout tho expenincMt, iiiul to Mm Eva Tinker who not only noted na subject 
but ifl also icspoiiaiblo for llio work of lalnilnling the rcsvdUs 
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There was some variation m tho tune of day ut wlueli tlio n'ading was 
done, but as a rule it wus earned out during llic early port of the 
evcuinp;. 

The reading inaleruil used during tlu* spring and suinmcr included 
two detective Btonea and one novel.* During the fall, approximately 
half of "Pfiychology, Its Facts and rnncjplos,” liy H. L. Ilollmgworth, 
was read. The last type of nmlcrlul was lielter muted to our purpose 
than were the earliei .selections, because of its gu'iiter uniformity from 
page to page. It ih piobablc lliat of the iiiegulanty in tlio chaiacter 
of the fiction matcnal used for the firat part of live expeiunont, willnts 
fiequcnt ehniige.s fioin conveiHation to deaoiiplivo mailer, accounts 
at least in pm t for the irregularity of progress in the early portion of the 
learning. 

Marked individual diffcronoc.s oxihUhI among the four subjects in 
the ability to adapt tlioin&dvcH to the rcverMid image in mirror reading, 
and these difforcnceH increased rather l.linn deeic'used with prac¬ 
tice. All four Buhjecis showucl rapid imprnvoiiient during tlic early 
Blages of the learning and very slow gam llw‘reufter 'L'hcio i.s a distinct 
lapse in cfTicicncy upon taking up encli new hook. Tins dilTeroncc is to 
bo attributed clueily to the large nunilier of new words winch were 
encountered witliin the early alageH of lending a now book, rather thnn 
to a change in the typography The nixe and style of typo was very 
similar for tlie four books 

For the entire experimental period the luoan uumher of woulsiead 
per error was as follows: For Subject No 1, 13S, .Subject No. 2, 347, 
Subject No. 3, ]63; and .Subject No. 4, HI. With llie evception of 
Subject No. 2, theic is but small difference m accuracy among the 
four readers 

While the foicgomg rcsulta have some intmost for the general 
subject of learning, the main interest has to do with the nature, fre¬ 
quency and position of the erioia made, and Iho relationship of these 


• la order of rcnclinR, tho hooka used weie; 

1. Gluck, .S ''The Green Blot.” 

2. Jordan, E. Cl.: ”The Blue Circle ” 

3 Vance, L. J..'*White Pile ” 

4 IlollingworUi, II L.: "PsyohoIoRy Ita Ends and Principles'' 

The first and third woio read completely hy all four nul)jccls Sulijccts 
No 2 and No. 3 read about half of tho necomi hook, liieu auiisLiUilt'd ” The (Jlobod 
Book” by J. E Meyor, Approximately half of tlna was road HubjeoLs No 1 
and No 4 completed the second book without suhstitiUion 
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factors to word-porccpLiou. A summary of the cxperiincntal findings 
to date* reveals some lack of agreement as to the relative impoTtanoe 
for perception of total word-form nnd of the separate olements or 
letters of which a word is composed, or in other words, whether words 
arc commonly apprehended as configurational wholes or by successive 
perception of their hepaiate parts or letters. The consensus of opinion, 
however, accnia to bt* m favor of the former hypothesis The experi¬ 
mental finding of Cattell,^ M(‘S‘3mor,* GoldBchcidei and Miiller,^ 
Erdmann and Dodgo,* Pillsbiiry,’ nnd others ore m conformity with 
this viewpoint 

Although it seems fairly well demonstrated that pincticed readers 
tend to pcrcoivo woids as units, lather than as aggregates of smaller 
elements, the impoitance of the analytic method m budding up these 
larger perceptual wholes must not be overlooked. The tendency to 
revert to a mothod of analysis in terms of single letters or syllables 
upon oncounleriiig a now or dilficult word was very evident in all four 
subjeolH This appeals to have been the major factor in producing 
the characteristic drop iii tlie curve at the liegjnnmg of each new set 
of material whoio a huge luimboi of now words were suddenly 
introduced into tiio lending vocabulary. The changes were maiked, 
not 80 much by incicuso in the total number of errors made, but 
rather by frequent Iicaitatious upon encountering new words. At 
these times theie was usually silent or audible spelling of the entire 
word or soino pmt of it, or attempts at leading by syllables 
Examples follow: 

Subject No. 4 upon encountering the woid lapse on the seventh day 
of practice first hesitated while tho word was examined, then spelled 
ha-p, then, unable to decide ivliothcr the following letter was an a or 
an s, passed on to ibo final letter which was also pronounced aloud, 
e This made ifc possible to bridge iJic gap, and tlie word was coirectly 
pronounced 

That this proceduie was frequently employed by nil four subjects is 
evident both from then introspective icpoUs anrl from such overt 
behavior as the oral spelling of words or syllables It was found to 
occur at two levels, in tlie apprehension of single words, as in the 
example given, and in the leading of sentenco.s or phrases, when an 
entire word miglit bo passed over Lcmpoiarily to be later supplied by 
the context In lioLli instances, however, it seemed probable that the 

* M A, Tinker' ViHUftl Apprehension nnd Perception m llending. Pdychology 
Bulleltn, Vol XXVI, 1929, pp 223-240. 
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context was not the solo factor iii HupplyiiiR tlio missing element, 
but rather that it functioned in cnimcclion with certain vaguely 
perceived elements in the total form of woid or letter which were 
not at first sufficiently clear to permit iinaided recognition. This 
viewpoint is in general agreement with the findingH of ZeiLlcr,® Winch/ 
and Koitc/ 

It la clear that tlie method just descrilietl may give rise to errors 
as well aa to auccca.ses. Tlim m illuHtiiitod by the Ireutmcnt given 
to the word roused by the anine Hubject on tiin same day. Tlic first 
three lettera r-o-u were spelled aloud as hofoic, and again the s proved 
a stumbling block. In this casci howevorj perception of the find 
letters resulted in an incorrect interpolation of the missing part and 
the word ^Ya3 finally pronounced louiirfcih The extent to which 
this method h'as been employed may ho inferred from the distribution 
of 1795 errora in which tho gcnorul form of Iho sulistitutod word was 
similar to that of the correct word, t.c, diffoied from it by not more 
than two letters. l''or the four subjects conil)nicd, tlic number of 
such errors occurring at the beginning of the word was only one 
hundred sixty-four, as coinpaicd to seven liundred iilnoty-six at the 
end of the word and eight hundred lUirty-live. in some Intervening 
position. Tlic overwhelming importance of the initial portion of tho 
word for total apprehension has \mm notc<l pievioiisly hy Gnldscheldcr 
and Muller,® Huey,* Pillsbury,’ and ot)M*rs. 'JMio corroborative 
ovidonco offered by our study law special significivnoo, since it shows 
that it is tho fact of position rather than location at tho right 

or loft side of blio word which is tho detei mining factor. This factor 
IS of sufficient strength to cause ludividualB whose previous reading 
habits have presumably taught them to give spoeuil weight to tho 
letters at tho left-hand side of the word, to rcveiso their habits com¬ 
pletely with the icveisal of the usual or<ler of letters within the word. 
While tho numbci of cases is loo Binall to warrant generalization, it 
18 interesting to note that the substituted woid is somewliat less 
likely to involve n change in the context m the case of iho two most 
rapid readers than with the two slower readers In thuty-onc per 
cent of the errors of this kind made hy Subject No. L and in twenty-five 
per cent of those made by Subject No. 2 tho siilistituled woid was an 
approximate synonym for tho correct word, an ooinjnued to ninolcon 
per cent and eighteen per cent for Subjcclfi No niid No 4 icspec- 
tively. This BUggcsL.s the possibility that tho moio rapid loaders tend 
to fill in their perceptual gaps upon tho basis of larger context-units 



Mtiror Reading 


497 


tliaa do the elowor rcacicia. A somewhat similar situation in the 
apprehension of single words is suggested by the fact that the two most 
rapid readers make a greater pwccntngo of the total number of errors 
111 the middle of the word than do the two slower loaders This may 
bo the result of a soinewliat greater tendency on the part of the more 
rapid reader to “jump over” larger areiiH in the apprehension of words. 
01, in other words, to identify woids upon the basis of a smaller number 
of “determining” cloinents Further data with a laiger number of 
subjects are needed to verify this hypothesis 

Errors of inflection involving a change only in the piefix or suffix 
with the root word rcinaiiiing unchanged, have been ti cated separately 
For the four subjects combined, theic aic eighteen instances of a 
change in the prefix ns compared to ihico bundled thirty-three 
instances of a cliango m the suflTix. The importance of the initial 
position 18 again clearly <lomon 8 tiatcd 

A total of one hundred forty cases in whicli one word was sub¬ 
stituted for auoUici of voiy dilTcient form but of similar meaning were 
made by the four fiuljjccts Of those ninety-four, or sixLy-scvcn per 
cent of the total woie made l)y Subject No 1 who was the most rapid 
reader. Again the use of largoi context-units in the case of this 
subject is euggcsiod. 

OmisBion of letters or Hyllablcs follows the siiinc general pattern 
as substitution of lottois or syllables Out of a total of one 
hundred ninety errors of tins kind, sixteen occuned at the beginning 
of a word, forty-four ui the muldio and one lumdrcd thirty at the 
end Fifty-fivo per cent of the total immbcr were made i)y Subject 
No, 1 . There w(‘ro one liundiod forty-eight instances of omitted 
words, and fifty-six inslaiiees of inserted words One hundred forty 
of the former and forty-two of the lattoi weio attiibutai)le to Subject 
No. 1 . 

Errors resulting from a rcvcisal of the order of letteis within the 
word, 01 williiu some putt of the woid wcic of faiily fioquent occur¬ 
rence. Thero weic three hundicd forty cases of complete leveraal 
This category includoH all cases in which the beginning and end of the 
word were intoiclianged, with ni without accompanying icvcrsal of 
intervening lottoi's, Example; for iold foi dolt, on for no, 
etc. There were one lumdied seventy ciisch in which the icversal 
affected only a par i of tlio woi d. Tlieso have been chisBificd according 
to the position of tlio lovorsod portion within the word In thirty- 
eight cases tlio ordci of tlic letteis making up the first syllables was 
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reversed on initinl attempt or pronunciation, c.fy., now for the first 
syllable of wondering KrroiH of IhiH kind woio likely to be corrected 
spontaneously, Hince an a rulo their nature was nuch that the word 
could not be scnBildy completed without conectiou In one hundred 
sixteen coses the initial and final letters wore correct, but a revorsa] 
was made within tlio word Form for/rant and vice on^a is a common 
example. There were Hixtoon cases in winch tlio revi'isal occurred 
at the end of the woid, tin tinlil Un unlit In thirty-four casos tho order 
of words within a phuisc or short sentence was reveiscd, as ts ti for 
tl is, etc. 

It is impossible to say to what extent these revcMsala are the direct 
result of mterfcroncc from the normal rcading-linlnt and to what extent 
they represent perceptual difllcullies of a moio fundamental nature. 
Every primary tonoher knowft the difficulty which niost beginning 
readers oxpciienco in learning to distinguish hctwccri such words as 
was and saw, fell and let; on and no, etc. 'riiiit intiMforonco factors 
were operative to some extent, at IcuHt, in the picsmit experiment was 
evident both from the mtro.spoclivo reports of the subjects, and from 
their overt behavior. In tlio hoginmng of tlio expeiimcnt all subjects 
reported that tho page not only niipcuicd to be leversed from right 
to left but also to he ujwidc clown. This led to considerable difficulty 
in passing from one lino to another or ui Roing frmn page to page One 
Bubjcct almost invariably licgan a new page at the bottom instead of 
tho lop, and for all theic wim u pprcciiliblp jierioil of fumbling adjust¬ 
ment at tlie beginning of each now pag« during the eiiily pait of the 
cxpciiment. All found it inoio or Icm difiioult to shift fiom line to 
line; and not infrequently the devioe so often employed by little 
children under similar difTiciiltics- that of following the line with the 
finger or of pointing to eacli .successive hue in order to keep tlie place 
was bi ought into use In spilo of these dcvicrH, and tlio eaily recogni¬ 
tion of the existence of tins particular type of diflieulty by all four 
aubjects, in twenty-one ensos an entire line wa.s omiUed in reading; 
m seven cases a line wns lepcatcd, and m two iiflditioniil cases the fixa¬ 
tion point shifted to the adjacent line witlioiit nwanmehs on the pmt 
of the subject, who, as a result, read half of one line and half of the 
following line. 

Tho effect of intorforence is also neon in certain letlet-confusions 
which woic frequently made It is a matter of common obseivation 
that noimal children upon learning to road laiely have nuiuh trouble 
in learning to distinguish words or IcUcrn upon a vcitical or up-and- 
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down basis, bul thaO blie hoiizontal, oi right-and-left distinction 
frequently causes much tioublo. AaTcrinan has expiossed it (“Meas¬ 
urement of IntelliKcnco/' p. 177) "it la the "p's" and that chil- 
dieii must be told to iniiul, not the "p’s” and "t’s ” For all subjects, 
however, d and p wore confuacd more ficqiiontly than any other letters, 
with h and d ns a close second. Tlie opoiation of the “up-side-down.” 
illusion lias almost coitainly beon the determining factor in the first 
instance Other letters frequently confused wore a and s, h and h, 
and w and m In general it may bo said that such confusion is most 
apparent in the case of lotteis made up of identical or closely similar 
elements, thus necessitating a distinction upon the basis of spatial 
position only 

Although it IS evident that a comparison of word-confusions or 
letter-confusions witlun material such as this, where individual words 
or letters occuried with unequal frequency, and therefoie had unequal 
chances to bo confused, cIoch not peimit too wide genoialization, it has 
nevertheless seemed worth while to tabulate the woi d-confusions which 
were found to occur most frequently within the limits of oui material 
The results of tins tabulation aie shown below 


0/for to (or inco i^eraa), 8H, mt— no, 08j 8aw—jms, 00] the — Urn, 19; ihal—lhu, 14; 
hll—JeU, 12; tiqio— icon, 11; teW—lei, U; Iho—lhal, 0, die—/m, 8; facc—^ad, 7; 
physiological — psychological, 7; anrf— any, 7; though — Ihiough, 0; pari — past, 6; him 
— his, 5; to — or, 6; cuer— even, 6, whatever — whether, fi, and —biU, 3, started — stared, 
3;/or—£>/, 3, pvl—hul, 3. 

The findings of lOrdnmnii and Dodge* and of Pillsbury’ appear to 
show that word-length is an iinporlanl factoi in the determination 
of word-form. Zoitlor® on the other hand, regards word-length as a 
factor of minor inipoitancc Our findings clearly bear out the former 
viewpoint. A tabulation of a total of 2812 oiiors (not including omis¬ 
sion or insertion of ontiro words) yielded the following results. 

No clmiigo 111 nuniliei of lellers, 1506 onsos, difTcience of ono letter, 1027 
caaca; of two lettora, 202 cnscs, of three letters, 66 eases, of four Icttci a, 17 enaca, of 
five loLtora. 3 caaca, of hix loiters, 2 eases; of sovon letters, 1 case 

It will 1)0 noted that nmoty per cent of the eirois do not involve a 
change m word length of more Limn one letter An oxaim nation of the 
nature of the most fieqiient on ora nsicportcil in aforegoing parngraph 
will show that in none of those inslancos is the change in word length 
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greater llm» one lell(*r, while ui eighly-five pei rent of the errors 
included willun thi,4li.st, noelumge lu woul lengih 1ms liikeii ]>lacc. 

Since only four s\il)jec1s purlnnpalcMl in lire experiinent, ib was 
thought llmt il wcivihl he worth while lo hee to wind e\lent individual 
idioflyncrnsies might he nffeediig the general liend of (ho roaulta, 
or, in other words, to see to wimt e\leiil the (lisliibiilioii of the various 
kinds of eiror nuglit vaiy fioin Mihjeei to wilijeel We liavo therefore 
chissifiod the eiroia imuh* by eiieli Hulijeei under liie dilTeicnt heads 
clisouHsftd provjoiisly, imd then eomimted liie nuik-ouler eorrclatlon 
between the cominualive fie(i«eiiey of the various tvju's of error for 
each fiubject with every other aiihjeot. The calrKJiries iiHcd in classify- 
mg the errnis will he repeated hcie for etmvenienee. 

Oini^Hiou of hue 
Uopctvtiou of Urn* 

Mixing up two hiWH 

Oinifsioii of letters or Hvllahles at hegininng of w onl 
OiniSHioii of Hlersor mlluhlcH ul end of woul 
OmiNiion of haieis or KyllahleH in tniddh* of word 
Suhsliiuliou or addition of letters nt iiegiuning of ^vo^d 
SulmiaiUioit or addition of letters at end of word 
SuliHliUitioii oi nddiluiu of letters in imddli' of word 
llovoranl of entire won! 

Partial rovorMid nl heginnuiK of woo! 

Partial reverfiid at end of word 
Partial reversal in middle of word 
llcvcrsal of wools or plirnses 
PlniiKcs Huhst tinted or ndiled 

The iiiLcr-coirclaUon between the order of fieiiueimy of I ho various 
types of error for the four eubjocts rangod from -l-.fi? to -I-.85 with an 
average intorcorrclatioii of -j-.yr) In a Hunilar mumit'r wc have com¬ 
puted the rank-order coiiel(ili(m.s botwoon the fictpiency of vaiious 
single-letter confusioriR foi I ho foui aubjcolH, iiHiiig only the twelve 
CQufuaLonH most frequently imule, and in tins cast* (hlteicutiatmg 
between the two altcvnativeK in each pair. 'J’ho Imt of confusions 
follows; b for d, b for p, d for b, d foi p, f foi I, p for b, p for d, u for s, 
7ifor b, la for 7/1, t foi /, « foi’rt In IhiHcaw' the iiiLui-eoi'Kdations riingcd 
from -|-.20—1-.78 with an aveiage intei-roriehilion of -I- 50. This is 
in close agiecment with the coirt'Hpondtmce between nidividuals found 
in moat of the icportcd studrcH ou the. relative legibility of individual 
letters. 
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SUMMATIY 

i Tlio rofiulls of a learning cxpeiimcnt in the roacling of English 
prose from the icversecl iinngo shown in a mirror have boon utilized for 
the study of coitiiin faetors influencing word-pcicepUon 

2. Four adult readers participated m llio experiment. Practice for 
ton minutes daily was named out by each subject over a period of 
approximately live* inonths. Mai Iced individual difForcnccs in speed of 
reading were apparent fumi the beginning, and those differences tended 
to increase with practice 

3 An analysis of the errors made in terms of their position withm 
the word yielded insults which are in conformity with tlioso of certain 
previous investigators in tlio following respects (1) The initial letters 
were found to be of far greater iinpnilancc in the apprehension, of 
words than the final or the inlcrinodintc letters, (2) The context was 
frequently utilized in the final apprehension of difficult words or in 
deciding among the various nltornativcs suggested by imperfect or 
paiLial perception, (3)\Vord-lcngth appeared to be a factor of major 
importance in doterminmg word-form 

4. Interference from tlin nornuil loading habit was shown, not only 
in the reversal of letters or of letloi-clomenls in the horizontal direction 
which 18 n difTiculty frequently found among children when first learn¬ 
ing to read, hut also in the presence of a definite “up-sidc-down’’ 
illusion which tended to pro<luco siinihu confusion in the vertical 
direction 

5. A fair degico of coriPHpondcncc was found among the four 
subjects in rcgaid to tho lolnLivo frequency of tlic dilTcrent lands of 
error made The mean inter-coirolation of tlic order of frequency of 
certain specified eirors clasbiiiod on the basis of their naiuic and thoir 
position within tlic word was +.75 for the foui subjects; between the 
frequency rank-oideis of the twelve most common letter confusions 
was + 59 
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the hetention of mirror-reading ability 

AFTER TWO YEARS 

FLORENCE L ClOODENOUOlI AND MILES A. TINKER 
University uf Mmiicsotn 

Tina atudy wan to aupplcmcnt an enrlior invcaLigation 

by the authora* on i)r()gres8 in learning to read ordinaiy prose material 
as viewed in a mirror 

Four aiibjccls pailicipaLcd m the oiigmal atudy. Practice was 
earned out for ton minutCB daily over a peiiod of approxiitiately 
sovontcon weeks. 

Two years later, an experiment m relearning was undertaken. Ten 
minute piacticG pouods woic employed as before. Practice was con¬ 
tinued for twenty conbccutivc days, The book used was “Psychology, 
Its Facts and Principles," by II. L. Ilollingwortli The first half of 
this book had been road at the end of the oiigmal learning study. 
For re-lcarmng the second half was used, thus insuring similarity of 
subject-matter without the use of identical material. All four of the 
subjects participated in relearning None had had any intervening 
practice. 

A compari.son of tlio uiimber of lines read per day during the 
rc-lcarning ponod witli the conesponding miinber icad during the 
original learning is prosonted in Table I. 

In this table the mean numboi of linca read during each successive 
five-day period of the relearning exponincnt is compared with the final 
stages of the original learning in which the first part of the same book 
was used. The numlior of days piacticc on this book was the same for 
both learning and loloaining. 

The rank-oidci of the four subjects is the same for both learning 
and relearning, if the average for the twenty days of practice is con¬ 
sidered. With fow exceptions, this is also liuo when the data are 
grouped by successive live-day stages Two of the foui subjects make 
a distinctly higher scoio on the icleaiiiing than was made during the 
final period of learning, in spite of the fact that theio had been no 
intervening practice. The remaining two subjects made appioxi- 
matcly the same avoiago hcoios on both learning and roleaining. 

‘ Tinker, M. A and (toodcnougli, F L. Miiror RoadinR na a Method of Analyz¬ 
ing Faefcora Involved in Woid-pew'option. Tins Jouunal 1031, Vol, XXII, 
pp 493 


SOS 



604 


Tho Journal oj Kdw nlimud P.syrhnlogi/ 
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//, inpftn minihci of Imoa n*ftd ptT <lnv iluniiK Ihi* oriKiiml Icnniiiig ponod 
fi, menu n\i)ii)i('r road (UiriitK roli'iirniug (diffuTont ixirtioiiH of the Banio book 

UBod) 


One gttinod 0 4 of a line, iJio olhei lost 0 (i of it Imo Wlion the everage 
score for l)io fubL five duy.s of n'lcarniiiK ih coinpured wiLli the last five 
days of tlic original IcuriiiiiK, ul) Bulijcols nhow u Blight loss, but this 
loss was moio thati recovered by (he eml of the necoud live-day period 
of roloftrniiig. Those resultH indicnle that with adult Hubjccls, roton- 
tion in miu’or-roadmg temis to permHt ivith jinicliciilly no loss m 
ofticicncy for a period of at least two yenis. 



VOCATIONAL INTKRKSTS AND TYPES OP ABILITY 

RALPH H OUNDLA-CJH AND ELIZABETH GERUM 

1 liiivwrtity of WnKhiiigloii 

This papcn pii'Ki'iilH rHlunuU'a of the inLei-coirolaLions bclwcon 
hficcn of ilio voeaiioiiH iiimaurod by Strong’s Vocational Interest 
Blank, and offois u parlinl analysis of tlic types of interest which arc 
in part lesponsiblo for the dogioc of correlation. 

Wo have several times found a need for ii knowledge of the inter¬ 
relations lictwoen the various occupational groups ineasuicd by the 
Vocational Intoicst Blank. The manual of directions contains 
figures of intci-coi’iclalions foi about twenty pairs of vocations; but 
there are stencils and norms for almost that many occupations The 
manual, further, gives no indicalion as to the niimbei of cases upon 
which tlio correlations arc based, oi the PE’s of the correlations It 
would be an enormous task to work out the actual inici-correlationp 
with an adequate mnnbesr of cases. 

Our own elTorts were directed toward obtaining, fairly easily, an 
estimate of the actual coi relations Instead of using scores made by 
various incUvuluals upon the tests, wo used the stencils themselves; 
instead of using the fully weighted scoios, we used only the sign of the 
score, anti iuHtead of iisiiig llic total blank, we used only foui of the 
sub-tcsls (lA, IB, 7 and 8). A relative measure of tlie degree of 
correlation in interests between two vocations m each of these sub¬ 
tests was obtained by dctcimining the number of agreoments m sign 
m the "Like,” “Indiffoieiit” and "Dislike” columns for all items; and 
fiom this figure was sulitracted the number of agreements which would 
be expected piiiely by chance When these data from all the voca¬ 
tions and sub-tests used were added and assembled in a table, the 
rough relations between the various occupations could be scon, but 
their significance in terina of the coefficient of coiielation could not, of 
course, be determined. To make a conveision possible, these figures 
were correlated witli actually dotciinincd eoriclations between voca¬ 
tions. The actual coiroiations were obtained fiom those published 
in the manual of directions and fioin Coiroiations we had determined. 
Strong does not state the number of cases upon which his correlations 
are based Ours aio liused only upon fifteen to foily cases When a 
value for any pair of mtci’csta occuned in both souices, the average 
was taken. There woie finally thnty-four different coirelations, 
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ranging from —.10 to 88, whicli were plotted agamsb the correspond¬ 
ing esLimatca. Tlie correlation between the actual correlations of 
interests, and the eatimnteB of ugrooment, based upon the signs of the 
weights, is .918 ± .0175 By meana of the obtained regression 
equation each of tlio values in the table giving the lolaiivc closeness of 
agreement of the, vocational interests was convoited into its moat 
probable coiiclalional value. Table. T gives these estimated inter- 
corielations. The m .075. As a check, the differences between 

the thirty-four actually deternunod and the corresponding piediotcd 
correlations were plotted • The VV, of the distribution was .079 

Even a ca.sual inspection of the tabic shows many indications of 
group factors. Since llic actiml basis of the degree of correlation 
between any pan of vocations can bo found in the stencils, an analysis 
of factors involved could readily bo made providing there was a 
significant set of categories for classifying the various items. Follow¬ 
ing Tliorndilco’fl fluggostion llml lliero aic poihap.s tliroo types of 
inlolligonco, and assuming a close lelatiou between inteicsb and ability, 
wo firab abteinptcd a clnssification in tcims of the categorios, Abstract, 
Mechanical and Social. It soon appealed that those classes needed 
amplification and aulxlivision. After sovcial trials, what appeared 
to bo a fairly com]ileto cliiHsificalion, with five main headings and a 
total of twelve sub-hcadmgfl was constructed. Three of the main 
headings conespond to Tlioriulike’a Abstiact, Social and Mechanical 
intelligenco. TJio r(!mftinjng iieadiiigs collect the lathor inieoellanoous 
Bub-groupa Hint fitted in no particular place Nino diffcient indi¬ 
viduals, representing five dopartmoiits of msUaction, acted as judges. 
The judges classified the itema m entire indcpcndenco of each other; 
and in view of tiieir complaints ns to the ilifiiculty of making the 
classifications, tlio amount of agrceinont among thorn is surprising 
The judges omitted a number of items whicli they held weio not 
classifiable into these types of catcgoiies. Hence only the first four 
sub-tests of the Dlnnk woie eventually used Tlio judges were asked 
to indicate which items Uiey felt belonged under the following headings* 

(A) Social jntoroslB 

1. Dcsiro lo (loininato or I)Ohb a gionj) (aiiny ofiicor) 

2 Dpsiro to 1)0 oxlubitod lu^foio a Kroup (actor) 

3 Doiiro to minglo in a uiowd (iHcnics), 

(B) Iritollcctvml intorcstH 

4. Einpinral (pliyHios) 

5. AbstiAcI; (mnlliofriniics). 
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(C) Technical mtcresls 

C Clerical (bookkccpci*) 

7 Mechanical (aiito lepaii iuftTi) 

8 Toohnical-profcssional (dentwt). 

(D) Creative interests 

9 Artistic (nitisb) 

10 Practical (music teacher) 

(E) Interest in physical skill 

11 Competitive (auto raoei) 

12. Non-compctitivo (taking walks) 

Those items which four or more of the nine judges agreed m classing 
under the same heading were conaidcied as properly placed. All 
others were omitted. 

It remained to compare each of the stencils for the various vocations 
with this analysis of the interests. Any item in the Interest Blank 
may be marked "Like,” “Indifferent” oi “Dislike.” i‘’or any partic¬ 
ular interest any of these alternatives may bo weighted much or little, 
and with a plus or a minus score All “Indiffeicnt” scores were 
Ignored. Only fairly heavily weighted positive or negative scores 
(four or five, depending upon how many such items appealed in the 
paiticular vocation) wore considered. Score was totaled by counting 
one each for positively weighted “Like” items and negatively weighted 
“Dislike” items; and by subtracting one each for negatively weighted 
“Like” items and positively weighted “Dislike” items Accordingly 
it was possible in scoring one vocation to have a count of zero, one or 
two (plus or minus) for every item Table H presents acoies obtained 
in this fashion for fifteen vocations for the various types of interest, 
converted into per cent of perfect score The Minister's scoie, e.g, 
of fifty per cent under Creative artistic mtcrcsts, means that that 
profession had a score of seventeen on these seventeen items 

Considering the various vocations as wholes, it fiist appears that 
none of the vocations can be said to depend only upon one or another of 
the major groups of intei'ests. A very important faetoi seems to be 
what members of the vocations dislike. Heal Estate Salesmen, and to 
a lesser extent, Lawyers and Journalists, are characterized chiefly by 
their almost universal dislikes, while the Ministcis, and to a- lesser 
extent the Teachers and Personnel Managers, aio characterized by 
omnovorous likings. The inteicsting chamcteristics of the individual 
vocations are too numerous and too readily observed to bo noted 

We may now turn to the relations between the groups of interest 
If Thorndike’s suggestion thnt there are thiee types of intelligence 
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Tecluucal, CD—clerical, M—^meeliajucal, T—technical professional 

Creative, A—artistic, F—^practicaL 

Still, Ph—physical competitdve, N—non-competitive. 
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IS true; and if, as haa been fairly well cstabliahod, there is a close 
1 elation between abilities and mteiests, then the coi relations between 
tlic classes within each of our major headings should be high, and the 
coriolntion between any member of one group nnd any member of 
another group should be low. To facilitate such a cornpariBon, rank- 


Taulb hi.— iNTEnconnBLATroNB BETWEEN TUB VAKioua Cbabbes of Intbuebtb 
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Social, B—boss, B—exhibitor, M—unobtiuaivo miiigler 
Intellectual, E —empirical, A —abstract 

Technical, C—clerical, M— ^mechanical, T —technical piofeasional. 

Creative, A—artistic, P—practical 

Skill, Ph—physical, competitive; N—non-competitivo has too few onscs 

order correlations between the classes of interests wore worked out 
(Table III). Fairly high correlations obtain between the two Intel" 
leotual and between the two Crealivo classes of interests. The various 
Social classes and Technical classes, howovei, do not have such high 
intercorrelations. In fact, the averages both of the coirelations of 
Clerical interests with the three Social classes, and of Practical Crea- 
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tive intercattJ with tlie two Inlollcctual classeH are higher than the 
average inter-corrclaliona eillioi* of the Social or the Technical classes 
of mtercBt. 

If our finiil anulyms ih correct; llir giouping of "Sooial” interests, 
and of “Tcohnicnl" intoicatB mlo wnglc calpgoiics covers up many 
actual diffciencoa. Wo cannot agree that the tenna "Social,” 
Abstract" and " Mccluinicar’Bland for (hrec liomogcnnoua, mutually 
indepondonl, and colleetivcdy exlmuHtivc cntegoncs of ability. 



A VOCABULAllY STUDY OP BIOLOOY NOTEBOOKS 
OE PIETY llEEIlESENTATIVIiJ 8EC0NDARY 
SCHOOLS IN NEW YORK STATE 

DON 0, BAIRD 

ABaoomlG Professor of Biology, Hnm Houston Stiito Toncheis College, Huntsville, 

Tctne 

Thero have been numy vocabulary rUkUcs iniulc in icccnt yeors, 
especially in the field of elementary education Thorndike's "Teach¬ 
er’s Word Book” was a result of an extensive and comprohensivo 
study of the vocabularies of elementary pupils and average citizens 
Hecently Seiko made a study of words in leu well-known iextbonke m 
spelling in which lie shows very clearly that the problem of vocabularies 
IS by no means solved. Powers made a "List of Scientific Terms for 
High School Students/* in which ho lists the most important words 
from the field of natural science for pupils of the high school level 
Many othens, as Boiiser, Doran, Nchcr, Brandenburg, and Symonds, 
have contributed to research work in the vanous phases of vocabulary 
investigations 

The study hero piesonfced was made to determine whether there 
is close agreement in the vocabularies used m biology textbooks and 
biology notebooks as written by high school pupils, and to compare 
the scientific terms used in such notebooks with those found in Powers 
"List of Scientific Terms for High School Students” and with those 
found in Thorndike's "Toachci’s Woid Book ” 

The writer collectccl biology notebooks from pupils m fifty repre¬ 
sentative BGconclary schools in Now York State These notebooks 
were selected from the seveial classes in secondary school biology 
as good but not the best of each biology class The pupil vocabulary 
m these notebooks was examined to determine the following, extent 
of pupil vocabulary, extent of the use of Bcientific toi'ms, the total 
number of woids used, and tho coirect use and spelling of words 
The total of all tho soparato words used in tlio notebooks was 
checked against the Thorndike list and the I’owci's list. In making 
up tho hat of words used in the notebooks proper nainea and symbols 
were counted m the total count for all tho notebooks. The first step 
in discovering tho extent of the pupil vocabulary as leprnscntcd m 
the notebooks was a study of one of tho smaller and one of tho larger 
notebooks for comparison and to provide an initial woid list for further 
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study. Table I shows the icsuUs from the comparative study of the 
two notebooks. 


Tadlb I —SuMiun-i OK VocABUhAiiY Stwd^ ok One ok the Smaller and One 
OP TUP. liAiKu.n NoTnnooKS 


1 

1 

Bmaller 

notebook 

Larger 

notebook 

Numiicr of wordH uned but om e 

167 

063 

Number of words used one to four tiim-s 

313 

1,223 

Number of words used livi* oi more tunes 

100 

658 

Total BPparate words used 

422 

3,781 

Number of proper ftamoH 

16 

121 

Number of symliols used 

10 

74 

Number of abbrcvmlioiiH used 

4 

4 

Total number of words used 

2,220 

16,249 

Total number of words, inchnhng symbols, proper names, 



and abbreviations 

2,260 

16,448 

Number of words nut found ni Thorndike's list 

61 

287 

Number of scioiilific terms not fouiul in Powero’ list 

7 

68 


The total nuinb('r of Rcicn(i/ic teiniH used in all the notebooks is 
SIX hundred forty-five Many of llio sciontific Inins woio used but 
once in a sinRlc notebook, (loinpaiativcly few woids wore found 
to be mi8.spelled and but few woids "coined'’ by the pupils. Table 
II gives a sumnuuy of fhe vocuhulaiy study of fifty-two of the 
notebooks. 


TaRLII n—H uMMAIU ok IIIH VooABULARY Sl'UDY 


Totfll mirabcr of words ORod . 488,820 

Total numbpr of nopamto wokIh »ihp(1 2,358 

Total number of words not found in Thorndike’s list 344 

Total numbor of words not foniul in Powers’ Imt 87 


Table III — Words in the NoTEuooKft Not Found in Tuorndikij'b Tbaciibr’b 
Word Book, oa in Powers' List or Scientipic Tdhms ior Ilraii School 

Stodenth 


Absorption 

Atnoebft 

•Apex 

•Astigmaliam 

Adaptation 

Aiiiiilititm 

Aphid 

Auditory 

Adenoids 

‘Anal 

Appendage 

Aunclo 

^Advocacy 

Aiiopheles 

♦Ailerinl 


Aeration 

Anlennno 

Artery 

BaPiUus 

Agar ngar 

Antlier 

•Ashy 

Bactoiia 

’•Aboacl 

Antibody 

Assiinilftte 

Bacteriology 

Alimentary 

Aorta 

•Assnnilatioii 

•Bag-liko 
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Taom. UI 

—(ionlmuid 


*BailGrfl 

CoinbusUon 

lOpuloi iius 

Iiidigosliblc 

Bnst 

Complex 

lirosioii 

Inorganic 


Concave 

I'lsopliiiRus 

Iiisecta 

Booker 

Ooiiflcrvnhoii 

Kllicr 

IiiHolublo 

Bciioficml 

Convex, 

IiIuHineliiuii 

lulogiiment 

Dichloriito 

•Convolution 

*Kver\ liiuo 


*BiGoncavo 

Coordiimte 

Kxrietion 

Katydid 

*Bicuflpid 

•Coordmnlion 

Kxoskolrlon 


Bile 

Cornea 

Explode 

Lalnnm 

BioloRy 

Coiolla 


bncleal 

•Blottci 

Coipuacle 

Eacot 

Larva 

Boll 

Cortex 

Ffthrcnhoit 

Laryiw 

*Box elder 

Cotyledon 

•Eiiii'likc 

Lateral 

*Bionchiftl 

*Coxa 

I'Vliling 

liOgumo 

Burdock 

Ciayfish 

Eciinentation 

TiOnglhwiac 


•Cioss hill 

Filament 

Lcnticol 

Calyx 

•Gross Bcelion 

Fillor 

Liberate 

Cambrium 

Cioss-polhimlo 

•Flowor-liki* 

•Licoiico 

Capillary 

Giuoiblc 

Focus 

Limestone 

Capsule 

CruHtaeea 

Follielo 

•I.vsol 

Carapace 

Cytoplasm 

•Foik-liko 


Carbohydrate 


FormaUlehyile 

Maggot 

Carpol 

•Daddy-longlegs 

Fuiiugale 

Malaria 

*CoTrion 

•Decrease 


Mam mill 

Caudal 

Doliiscout 

Ciastne 

Mandible 

Cavity 

•Dcrangeineiil 

Oencinlimlioti 

•Mandrake 

Oclluloao 

Devnntato 

Geiiciale 

Maslieutc 

Cophalotliorn>. 

•Dexterity 

OorininAtu 

Maxilla 

Gcrebolhun 

Dinslaao 

•Glottis 

Medulla 

Cerebrum 

Dicotyledon 

Gram 

Medullary 

Char 

DioxkIo 

Guppo 

Mcmlirnno 

*Chitin 

Disitifcetaut 

Gullet 

Membranous 

’"Chlorate 

•Dissect 


Merge 

Chlorophyll 

•Disseneioii 

llehotiopism 

Mesothorax 

Chloroplast 

Dormant 

•Hessian 

Mctamor]]hosi6 

*Chylo 

Dorsal 

•ITihcnmUon 

•Mctathniax 

*Chyme 

Diupc 

Hydrochloric 

Metazoan 

Cilia 


Hydiogcn 

Micropylo 

Ciliato 

•Ectoplasm 

Hydrophobia 

•Microsca 

*Cinnamon 

Edible 

Hydroxide 

Microscope 

Cloaca 

Embryo 

Ilygiono 

Microscopic 

Clot 

•Emulsion 

Hygienic 

•Mold 

*Cocoua 

Encyst 

Ilypocolyl 

Molhisk 

Cochlea 

•Endoplasm 

Hypo-plmrynx 

Monocotyledon 

*Cochineal 

Endosperm 


Monocotylcdonoii a 

Cocklcbur 

Enzymo 

Icheuumon 


Codlin 

•Epicotyl 

Ignito 

Nnicotic 



Vocnlndaifi i^titdy of Iholoyy Nolrbooka fiJf) 


Taulk II[ - Oonlinucd 


Necessitate 

I'llolOHVUtllPSIB 

Kali\u 

•SmiliKlit 

♦Neuron 

Pliyfliologu 

•Salivary 

iSwimineiol 

Nicotine 

PlRIlll'Ilt 



Nitric (acid) 

Piniiato 

♦.Sawilust 

Tai'liiiia fly 

NitroRcn 

♦PmcPH 

•ScavciiHor 

TiicLilo 

NitrogonoviH 

PlHtll 

MciciitiHt 

♦Taproot 

Nodule 

Plnnsitii 

•Hclprolio 

♦’IVIhoii 

♦Non-fatty 

PlnHiiiti 

Ki'lmcixniH 

Tf'sla 

NucIqub 

♦Plmlih' 

KlM'lOlO 

Tliomeic 

Nutrient 

Pluinuh' 

Spcrctidii 

Tlionix 


Polliiialioii 

Sc'KPiiiPiil 

Tihia 

•Onc-ccUcd 

Poiuo 

ScKiiiciilnl 

Trachea 

Operculum 

Poili'riar 

Srif-ronlrol 

Trangiucojit 

Opium 

Poln'<‘uum 

♦.Sianiciroular 

♦Transparent 

Osmosis 

Protisii 

•SciHifluul 

Transpiration 

Ovary 

♦Prothornx 

SciiHoiy 

♦Tnoliocyst 

•Over done 

Proloplnsiii 

•SlicotuiK 

♦Tncuspid 

Ovipositor 

Pioto/ou 

Koluhlo 

•Tnllum 

Ovule 

pHCudopiMha 

tSpiini 1(1 

♦Trocliantcr 

Oxidation 

Ptvnlin 

Kpinllmn 

Trypsin 

Oxiduc 

Piiliuomirv 

Hporo 

♦TarUe 

Oxygen 


•HpnUci 

♦Twrezprs 

(^unriintuio 

Sputum 

♦Typiioid 

Falisado 

Palmate 

Halucx 

Slauu'u 

•SlarliiiR 

♦IJngliuo 

Palpus 

♦Iditcra ((Sill) 

♦.SlPUpHIII 

Ifn'a 

Fanoreas 

♦Iliiphc 

♦SlcRumyia 

Urplcr 

Pancreatic 

Uodox 

StiTihvaliou 


Papilla 

Ki'iirodiicc 

SliRiua 

Vaopinalion 

Paramecium 

UeijroiliirtKm 

Sliiuulaut 

Vacuole 

Parsnip 

♦Uespiralion 

.Stuiiululp 

Vontral 

Pectoral 

lU'HpiiaUiry 

Stunulufl 

Veitobrato 

Pelvic 

Koliua 

•Slipiilo 

Viroo 

Pelvis 

llliiibaib 

Stoma 


♦Pericardium 

llodniit 

Stomata 

Weevil 

Petiole 

♦llod-shapp 

♦Slopiier 

Xyloin 

Pharynx 

Uootict 

Suffocate 


* Not 111 Powora' liat 

Concliulmg, llui wuUt would Huy it's ovulont lluvl biology has a 
technical vocabulary inoro or loss poouluir to it, and that the acquire¬ 
ment of tluB vocialmlary by pupilu is no easy task '^riioro m a cun- 
sidornblo rangi! of scicntifio toiins used m the several toKtbooks of 
secondary school liiology unci, as found in the; notebooks, Honio of tlioso 
terms nro used but onoo by pupils This would soom. to indicate that 
the technical vocaliulaiy of the toxtbooka may well be simplified, 
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especially many of tho Hcloiilific irriiiH arc not found in Powers’ 
“List of Scionlific Terms ftjr IIirIi .Scliool StadentH.” The fact that 
relatively few words wore nuhspcllcd oi iiicorrctUly used is noteworthy. 
It IB also evident tluit a Kimcral voenhulury of less than two thousand 
words is sufTicicnt for t)ic average hi|;h scliool pupil m tho study of 
Glemenlary biolo^^y 

IlinuunnAi'iiY 

Uonsf'f, ]'’ ({ , Uiirch, L H luiit 'L'liriK"!, M U . V<»*iiljiil!vry Trsls na MeusurcB 
of fjohool Kflicicjicy iS'cftool nw/i •S’ocictj/, Vol. II, pp 713-71H 
Bftirdj Don 0 •" A Study of Bh)1<»rv NtaehooW Work in New York Stale " T^iirenu 
of Pnblicationa, TeaelieiH Collem*, Coluiiihin UnmTsiLy, New York, N. Y, 
1Q30. 

ninndciiburg, 0 G.. rHjchnIoRienI Aspeina of JjuiKiiiiKe Journal of Edticalional 
Psyehoiogu, Vol IX, pp. 313-332. 

Dornn, E. W. A Slinly of t'ocnbolwriea. PcJagogtcnl f^cimnaru, Vol. XIV, pp. 
401-438 

NcKor, II L : MunsuriiiR llin Voenbitlnry of IIirU Hchool Pupils >S'c/iooI and 
Society, Vol. VIII, pi) 36G-36B. 

Powers, S. II. Voruhulary of Heionlifie Tei iiih for High School Sludonts Teachers 
College Hccord, Novomliei, lf>20 

Synionda, P M : Size of Ih-pogtiilioti iind llcrull VoeubiiliirieR School and 
Soctety, Vol. XXIV, pp. C50-5ft0 

Seiko, Ericii! A Study of the Vocalmlary of Ton HpcDojH Jilcmenlary School 
Journal, Vol XXIX, pp 707-770 

TUc«{wl\Ue,E Ii .“‘l.'Uc.'L’<w.dwr'tt\Y«td Uook ” Uwtecvuof l\vbUfto.UouR,Taanhew 
College, Columbia University, Now York, 1021. 



MECHANTCAI. “APTITUDE” Oil MECHANICAL 
“ABILITY”?—A STUDY IN METHOD 

O L IIATIVEY 

In 1928 John Cox, a pupil of Spearman, ataLcd tho major findmgg 
on Ina clocfcoraLo (liaHOitnl.Joii''' on nmehaiiicnl aptitude ns follows; 

Tho applicatiou of tijo leliad-tllffon’iicc critcnon to our spccifw, coirclution 
coo/Ticionts liAB fjulrd to cIwpIoho tlio piwiieo, Iicro, of firoiip fftctors , "i’Jio 
ic^ullinfi; appcifio poncktion is adequately explained by a huirIp factor miming 
through those metisuieineiils in which thia coriolatioii occurs (130) 

In a bncf discns.sion of its lelalion to olhev “abilities," ho pointed 
out that “mechanical aptiiiule'* ia to be atnctly (lifToicntiatcd from 
"motor ability,” which form of activity was “Bpeciolly avoided” in 
hi3 tests 

iSeoing, howcvci, that the iiciccption of Rpaee is largely developed by tho aid 
of motor sensiitions, (uid that the matoiml of tho tcfts wns spacia), it might appear 
at first sight that motor activity was nn iiidiicrt (Ictcnniiiant of success in dealing 
wiUi this raalciial but the pieeiso oslinialion of shapes, sikcb, and dislancoB, m 
wlurh motor cxpeiiciiees might eoiiceivnhly piny a part, was not required in the 
testa. The csacnlial pioeesscn on wlueh success or failuro turned wcio not por- 
ooptual but of tho cductive Icmd in wlucli inotur expeiiencc could haidly have 
assisted (107-108) 

In the initial donnition of liiH problem, concoining the use of the 
term “aptituc/o,” Cox wiotc 

Since tho term "aliility” must ohvmuKly extend ilsincnning to cover any hind 
of pciformanco wIuUovci, it would seem desirable to contiruc its employment jo 
this wide sonso, and to iiiio the loiin "aptitude” wlieii only the innate character of 
the "ability” le intended Employing Iho lermsin this wav, wo should say tlmt a 
person aeUmlly aide to eariy out "ineelianieul” work lias '‘mechanicnl ability,” 
while one who has tho nppropiintc innate mental coiislitution for acquiung this 
ability (ivhctlicr lie has nctuiiHy done ho oi not) may bosaaJ to posseas ''mcchnnicid 
aptitude” (40-41) 

In these three koy-statements, tlien, Cox makes his posilion clear, 
namely; 

1 That ho eouglit to discover, if possible, that innate "aptitudo” ivJiioh iindoi- 
lirg tho ability to oiitiy out ineohamcal woik, 

2 Tluit, as tlici result of {‘xpeiunonlalioii, wieh an aptitude was found actually 
to exist; 

3 Tliab it H i]iu<|Ufl 111 its lelalion to "ff” (8|X‘aiman'B "grncial factor”), 

4 That it IS ?i single gioiip /iirtoi, and 

6 That it IS not the same ns inoloi nbilitv 


Cox, J W • "Mcchanicftl Aptitude ” London, Mothonii, 1923, pp 210 
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TIio infitriimenlK (Icsls) uw'd ])y CJox conj<iKlod of mechanical 
models and diagrams of vanoushoils, winch Ins hiibjcets were required 
to explain Or complete in one way «>r anoihor, vt'rbally. That is, the 
function of i.lio subjeols was essentially cduriivc, non-manipulativc, 
non-motor Although it may be argued Diat, for eduelivo processes 
to be possible, ceriain implieil motor ichponscs must have been 
involved, at least in the past aciivusitioii of hubits, mwoitholess the 
actual teslrsituation involv<‘d no ovmt iiHiro-inuseular behavior 

Two years after CJox’s woik had been published tlioio appeared a 
comprehensive study of mecliamcal abilily* made possible by grants 
from the National Kosoarch CJoiiiicil l*reaumiibly Oox's work was 
unknown to the luithors of this volume, at any rale until after their 
own study had been comph'tcd, for no reference is made to it. Their 
findings me, novcjrtlieless, at least in tbeir major rcreumco, the same 
aa hia " As I'oguvds the uniqueness of mecliuuical ability," they wiotc, 
“the uvidcnce is consistently poBiUve" (2r»3). On tlie other hand (in 
contradiction to Cox's findings), 

mcchnnical ability . inolmhlv doo.s not involve iuiy nidkIc gonoial factor. 
Low iiitorcorrelatioiis liot\\(*pn iligorenl- aiejHiirPH of mprliamnil ability suggest 
that factors of high 6[)coittcity play a major rOlfl (300) 

Mechanical ability they found to bo "unupu* with lespect to intelll- 
gonce and also with respect to motor agihly" (301), this last term 
being used synonymously with "motor ability," and being measured 
by means of parts of the Oaifiel motor (gymnaHium) test 

The teim "meclianicnl ability" was defined in this study to mean 

tlio ability to euccoed in the nelual innniimlatioii of IooIh and matcrinla and Iho 
ability to Bccure information about tools, and maloriaii, and then uses {7) 

It 18 to bo difiorenbialed fiom mechanical "capacity," (a term 
which, to the present wnlci, appears to be somewhat synonymous in 
this context v/ith Cox's "mechanical aptitudo"t) 

The position of the co-aullioiB of this gioup-study is thus made 
cleai, as follows: 

*Pnlor8on D (t cl nf. ■ "Miiuicsotn Moohiuiu'al Ability 'IVala " Minnesota 
Univeraity Press, 1Q3Q, pages XXtl + (iKO 

t‘‘Capacity,’' wroto tlio authois, *'ih alwaya an nifori'iico fiom measured 
ability . F'or it is by no means ovidonl that tho dovolopmont of mochamcal 
ability may not be dotcrimncd to n oonsidcrakio extent hy llm proaonce and 
availability of tools and mechanical oquipmcnl" (7-8) 
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I. That thpj wiiRht to thscovn wholhiv tlwio w<*r(> a ''iiicoliatiical ability,” 
thot IS, Uio Ui Hurct'nl in Iho actual iimnipulatJtm of tnolH and matcriala, 

regardless ns to wlicithnr or not that "iibihtY” he enlindy attrihulablo to mnato 
capacity; 

2 That, aa Uio oulroiiic of r'SiH'iiinciilaUoii, llii-y Imvc lovcalcd such an 
ability; 

3. That it w iiiu(|iu' in ndalioii In vcilml nilollixencc, 

4 That it la, liowcvrr, jiiolmhly not a wiirIc Rroup farlor, hut n rotislellalion 
of factors of biRh niicrilicity, 

5 TJiat it IK unujuo in rulatiou (n innior nRilily. 

The instruinonlH (h'sts) hclcotcd n« lluui final l)aUory for llic 
meusui'cinenl of Ihm ‘'inoohuiiioal tibih(.y’' nompnzo: («) a teat of 
steadiness, (5) a caid-soiliiiK lost, (<•) a block-packing test, (d) a 
form-board (spatial-rclalionH) lont, (a) an assoinlily lost, (/) a test of 
mechanical knowledge (.SteiKiuial’s "nioclmnical aptitude”), and ({/) 
a paper formboard test Of those, th« fiist llirce would appear, at 
least in the judgiiK'nt of the wntei, to be closely similar to tests con¬ 
stituting part of (he Miles-SeaHhoro "motor skills” unit;'** whereas the 
spatial rolations and uHsenihiy leHlHiiivolvoconsidoralile manipulation, f 

In so far as lhes(‘ two htU(lt<>H bolli claim to have isolated and 
discovered "m,” they iigiee, in so far as Uio ojk* clearly demonstiatos 
to be a single guiup fucfoi, wbeicuH the other eiiually clearly 
shows that very probably il is not a single gioup factoi, but lathcr 
consists of a luinilier of highly siiecific factois, they aio m frank 
contradiction 

Ihofcssing to Ik* no moio Ilian an iiilciPhli'd onlookei in respect to 
the present diHCUHsioiis in this field, the wnlm lias, novcitholoss, 
ventured to seek eK[)lanationa foi tins contradiction lie submits 
the following aigiimrnts, llieiefoii*, with considerable diflidence, hop¬ 
ing morcly to attempt to cloai up the di(Tei*<‘nco.s which he finds. 

Dkfinitionh, and Dulimitation of Fikli) of Inquiry 

Possibly a significant roason for the diffeicuce m findings lies m 
the definition of thi' (icUl of mvestigalion Although both studies 
claim to have niviuiled "in" actually ('ox Inmts Ins investigation to 
the aptitude wiiieli !nalu‘rt meeliiuucal ability possible, it excludes 
manipulative alnlily; it di*als pujely with the cognitive processes 

“ A Btudy not iiu'ludod m llio Miiiiiosota bildioRuiiihv, but reported in dotail 
m Joiirnnf of General I’Hythdhgff, Vol III, 1030, pp 38-()r) 

tin this connection see eritimHiii by t^ox (pp tb-21, Ulb-IOfi) 
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involved m Lli(5 uducUon of HpAliul lolations Tho MiiinoRoLa study, 
on the contrary, clearly seeks to monsuro uiiuupulativo ability pure, 
the ability to use tools and mnteiiala. If, then, the iibiHly to educe 
spatial relations is a function acUiiilIy ibstiiiot from the ability to 
manipulate objects, it would iippear evident lluit confusion has arisen 
out of the use of tho dowRiialion "w ” In which case, poihnpa all 
that is uocosRtU'y is to decide on wmic olliei ayiubolio ileaigiiaUon for 
the factor of “meolmnical ability” Tho real difference, however, 
appeals to he more fiindamonlal than one of dennition alone, ns will 
appeal in the later discussion 

Basis oi' Selection of Ti:HTh 

In line with the difference in definition of fields of investigation is 
the difference in basis of BclccUon of testa, tlox decides against all 
available tests and consUucls Ins own—testa involving, be it noted, 
no overt manipulative or inotoi activity on pnit of hia subjects, 
Thus it could be argued that Cox’s claim that “nt” m not related to 
motor activity is subslantifttcd by dofinition Tlie Minnesota group 
is equally conaistcnt, but stiiclly in torni.s of technique, not of philo¬ 
sophical orientation. Teats, roughly designated "mechanical,” arc 
coirolated first with verbal inlelhgcnce and llimi with a shop-ciitenon, 
which, although of high loliabihty, is noverlheless, fiom the point of 
view of functional integrity, a aomewhat ambiguous oonglomcratc 
Those tests which correlate as low as posaiiile with uiteUigcncc and 
as high as possible with the eritcrion aie helcctcd to constitute the final 
battery—a basis of selection comparable, one siispeclH, with judgment 
in terms of the letter rathoi than of Iho apiiifc of tlu! law 

SrinuouB Aveiiauk Intkiicohiu'Jlations 

Indeed it would appeal that the nature of tho tests detonnincs the 
outcome. One actually expects Cox to discovci niaiked consistency 
among his tests,* On tho other hand, although the Minnesota tests 
are to bo clenily differentiated from voibnl intelligence, the fact that, 
taken as a group, they result in a low average intercoi relation does not 
.necessarily mean that here is evidence of the ah.seiioe of a huge single 
group factor. An examination of Table XXXYl (page 2311), "Intei- 

It 13 not nocessnnly implied by tliiB aiguinenl that (’ox'h “«i" factor includea 
all Availablo teats of "m " Tho denotation of a gioup fiictov, as the writer unclcr- 
Btanda it, is a matter of pioof, winch Cok hns not Hiibinittod NovoiLhclo'^s, so 
fai aa ho has gone, his tests consintontly agreo 
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correlations of raeclmnical ability tcata used in expeiiment pioper, 
corrected for nitonuation,” yields an interesting observation sug¬ 
gestively in confinnaUon of this coininenfc Tests 1, 2, and 5 are as 
nearly aa one could wi.sh tests similar to those described by Seashore 
{loc ctl ) us puioly inoLoi tests; whereas Teals 4 and 7 arc oasontinlly 
"manipulative’' and probably in part "eductivc”—that is, in the 
sense in which these terms aie uw'd by Cox in the critical review at the 
comincncemenl of liis (hosis. The average iiiLercorrolnLion of all 
seven tests is .27. But, when taken alone, the average inteicoirelation 
between tlio lliice motor tests is as low as .23^ wlulo llio corielation 
between the two tests involving manipulation is actually as high as 
.63. And a snnilai argument applies m lesppcL of nil of the tables 
aubmiUed on imgcH 432-133, 235, 238, and 232 I" Intercorrelate the 
tests which aio, an neiuly ns one can judge, purely motor; intcrcorre- 
late, again, those which are both manipulative and cductivc, exclude 
altogether those which fall into ncilhci category, and consistently 
one discovers a Jiigh average mtercorjelaiion for the manipulalivo 
tests, while tlio inotoi toslq inlercorrclnto even lower than the avoiage 
for the entire tnbh* ns given by the nuthois, and in each case the range 
of correlations is nai rower. Does not this Biiggest that possibly tho 
icaaon for low iniiucoiieUitions, the high specificity, thscovered by the 
Minnesota gioup is (ho fact that most of the teats used by them are 
actually little nioio than motor tests, and llniL their “m" is really 
pieUy much tin; same "factor” iia that wliicli Sonshoio clnimB to 
mensuio—a conslollatiou of highly specific inoloi skills? May we not 
look hoio for tho fundamental ihffeix'ncc between Minnesota's ‘Sn” 
and Cox’s? 

A prion thei c would appeal to be foui phenomena which one should 
distinguish in dealing with mechanical activities: 

1 Specific inoloi hIciUh pm hi* (jis unlicatetl by Senshoie); 

2 Maiupuliitivo or nii'cluiiiu'nl abiliLy (wliicli Ibc Minnesota gioup sought to 
measure It is not, nccoriUiiK lo Co\, the same ns tho “pincLicfil ability” sug¬ 
gested l)y Mftcfailaiic), 

3 McchuiuenI iipliludo (an iiileHeotivo aelivity involving tlio ability to educe 
apace rclationii liolwccii olijcels, without iiecossilalnig tlicii pichcnsion and niani- 
piilfttion); and fieittHy, 


* Cf Softsiioro's nucoircctcd iiiteii'otrclalioii of 25 

t It IB appreciated tlniL in cveiy rase thrui nio only two inampiilation testa to 
correlate The suggestion contained in this aigumeut is iicvoiLliolcss Buatained. 
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4 TJic flliorr iiitpllfctivo fticlor, Iftlif'llnl **g" Uy f'pCrtrinQii, wliicli presumably 
pervades «U cnKnilivn aoljvily, rnrhidinK thr tuorlmnirnl 

The Minnesota group aeoin« to have gol, home of bheHe concepts 
confused Fiom tlio point of view of int(*rnal eonsislLMicy its battery 
would appear to bo far Bupenor to (,‘ox'h. In W) far as its best battery 
of tests (not only ineclmtuoivl) corrolatcs liigli (aljoiit ,H) with a entonon 
of excellent reliability (al)out .05) it ih piobiihly perfectly satisfactory 
as a mcaaiin* of skill in shop-work perfonned by junior high school 
boy.s. The study is splendidly walcMllght Ihit, m view of tho above 
arguments, one wonders wliether ita ussumptions nre (mtircly war¬ 
ranted. Cov'a position, iit least in Iheoiy, appears to b(‘ the more 
securely lonalilo Itm teals aie conamtemt in I hat they deliberately 
exclude motor and nianipulalive activity in Iheir iininedialo solution; 
and m that, befoie finally tleterminuig the oigamzation of “m," Cox 
olimmatca (or olnuns to have elimimiled) the indiuMU’e of “g” from 
his tests. 

On the other hand, Cox’ji nuitoiial us vague and often exceedingly 
unsalififaclory. IIih populalioiiH are lieleiogeiieouH (by comparison 
witli those of tlio group study) nnd mo.st of lliein too smiill The 
same toata Imvo not iieen vised on all groups alike. And one is left 
with an uncoinfoitable aimpicion that 8Ucce.s.H in answering his tests 
(no scoring procedure lias been nuUcaled) depoiulR to Hiich an extent 
upon verbal intelUgoncc, Umt *‘m‘’ (oven w)»*n, In all intents and 
purposes, the induouco of ‘*( 7 ” has been eliininatod) Htill contains a 
povYcrful amount of “g.” 

It might bo nil intoicsting piece of rchcarch to analyBO m terms of 
tho tetrad difference technique the data olitiiinable fioin a homo¬ 
geneous group ill lusponse to (a) a test of vm'bnl intelligonce, and ( 2 iJ 
n combined battery including tests such as (1) Die Minnesota assembly 
and spatial relations tests (for “mechanical ability"); ( 2 ) a aolocted 
group of Cox’s models, explanations, etc. (for “inochnnical aptitude”), 
and (3) either tlie Minnesota tests for atendinesa, card-Borting, packing 
blocks, and tapping, and Link’s machine operaLois' tost, or some form 
of motor skills battory, stmilai to that developofl by Seashore (for 
“motility”). 

Cox and the Minnesota group have demonstrated how such an 
investigation can bo conducted l^oaaibility an exponment along the 
lines hero indicated might help to clear up tho basic issue.s involved in 
thoir major disagiconiGnl. 



THE RELATIVE EJ‘'E()IIT OF CIIILDRl^N OF NATIVE 

v.s, 1 ‘X)uei(;n born parents* 


9. I5I)S{)N HAVEN 
Hliui Stiitn Thuvpraily 

Tho probloin Ik'IC aMcinpl«‘<l la (o dKoiinuK' by ()bjoctiv(i nuians 
the relative elToit of clnldron of mUivr i»a. foicinii liorn jiaicnts. Tho 
mteresl in this at,inly giow j)ut of lecoRnilion rif tlu' tondoncy to clis- 
cnminale a^^ainst the foioiKuoi in Uio iniinnor which ho applies hnnseU 
in accoinpliRlung school tasks. The significimce of such an oxpciimcnt 
may bo moic fully appioninlcd wlion we .slop to considoi llial uppjox- 
imately one in every eigh (., or thii teen per ceiil, of the population of the 
United States is of foreign hiilli. 

The AQ, 01 Aocoinplisltiiieiil Quolionl, is used as the index to 
effort Tlio AQ is tho KCi (ediiuational quotient) divided by tlie IQ 
(inlclhgcnce (piotiont), Qiioling fiom tho 'j'wenty-Fiist Yearbook,‘1 
"The IQ is a iiieuMun^ of I hr naUve ability of the child and shows Ins 
potential rate of piogn’ss. The 10(i is ii iiiea.mu’c of t he edueationnl 
attainment of llie cluld luul shows his acliinl rale of progioHs. Tho 
Accomplishment Qimtient is the degiee to which his actual piogiess 
has attained to his poteiituil piogu'ss by tlie liest poasililc measure of 
both. It IS a mark whieh rviihiiileH Uie acconiplishnient of the child 
in toims of his own ability.” Fializcn’ fllate.s, “Rince the IQ is tho 
potential rale of piogies.s and the ICQ is the actual rate of progress, 
the ratio of the ECJ to IQ gives tlie peicenlage of what the child could 
do, that he has actually done Tina would he a mark of the child's 
effort, a mark of conennliatioii and niteicat that tho child has in school 
work, and so fai as no otiiri inherited traits than intelligence affect 
school work it is a mensiiro of the efficiency of a child’s education 
thus far. If tlioie arc sucli olhei innate bases it is also a measure of 
inlieiitcd traits, sucli as concenlialion and effort At any lalc, it is a 
measuvo of tlu' child's accoinpliHhmeni, and ho of tho effort and con¬ 
centration a.H they leally aio at present woiking luulci those school 
conditions ” Witty and Lehimui'* defimng iho AC^ say, “The AQ 

•Tlio writfli* w indchU'd to riofcssor .lumcH P Poilur of Ohio UnivorHity foi 
guiclaiico in tliiB fltiuly 

tNumboifl jfulioftlo ro/oronce m lahliogrnphv 
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18 a compaiisoii of the lOA (oducatioiml ago) to the MA or the EQ 
to tliG IQ Doviiitiona atiovr and below LOO incliciiLo the extent to 
which cdort IB expended Ri\d ability evicwd in the taskB of the school, 
Presumably an AQ of a LOO Indicate*! tlial the mental ability and 
the educational altiunineuC of the child oi grouj) aie developing 
coordinately.” 

CtoodenouRh^ loinindH m lhali iiiiinigrant groupB luul then immedi' 
ate descendants dilTi'r maikodly m then peifoinuinccH on the ordinary 
type of intelliKonce IghI She HUgReslH luo thooi'U'H to account for 
these difforeiiceH The liiht aBcvihea the iiifeiiov sbowiiiK to such post¬ 
natal factors ns infciior onviioniiient, pool physical condition, and 
linguistic Imudicaps. The second iocogin/A‘H to some degiec the effect 
of those faotois on tost-icsulls, but holds that it is mipn.ssiblo to account 
for nil the facts wliicli hav<* boon obseived uiioii any other hypothesis 
than that of innate diflGroiicos. Slio goes on to say, "Although a 
test IH coinpletoly inilependonl of languaKO, th(‘ rank ortlor of various 
racial groups conespondH very closely lo lh<* ichuUh of otlicr invcatiga- 
lions using vorhal to.sts ” 

Many exporinicnls have boon undcrliiKi'n ami u*])oitcd lolativo to 
the linguialic liandicap with which the foicigner ih faced when ho 
takes a test dpsigned to measure all childicii hut haa Iummi Htandardized 
on English speaking groups. 

Brown® haa made an invcHligation on rotaulalioii in several schoola 
lu northoin Michigan. Uo found tUcio wok a wide vanatiioii in 
rotai'datioii among tlio cliildicn of ililfeioiit mitioiialitiea. It was 
revealed that after a })upil of foieigu liorn paicnlH had attended an 
American school for one or two ycaiK, he tested as high by employing 
the TOnglish language as by using the imlivc i.ongue 

Young® in a study earned on ni the San .ioso scliool.s in which he 
used the Army Alpha and Belli Tesla on Anienciin, Italian, Poituguesc, 
and Spanish Mexican children, found that the Aliiha 'I'eal piovcd a 
better incaBure of tlio Latin groups than the Beta He concluded that 
language handicap was not the cause of scliool clilliculty. 

Jones’ made n comparison of the Hcoros on the Myois Mental 
Moasuic and the McCall MulU-Mentiil Seale, diseovoring tlieie was 
no appicciablo difforonco between the scoies made liy the luiUves and 
those made by the foreign. It ia coiilemied liiat (he foinu'r test ib 
largely non-verbal while the latter m highly veiliul 

A statement from tlio T'wcnty-SovPidli Voiubook by Bulks and 
Kelley reads,® "Wo find studicB that purport to measure the cfTccLof 
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language handicap on verbal mlclhgcncc test scores by comparing 
the menial ages of foreign childion earned on verbal and non-verbal 
intelligence tests. The mental ages of children of certain low testing 
nationalities commonly turn out to be closei to tlio norms of American 
children when mcasuied on non-vcrbnl tests than when measured on 
verbal onc.«s But m ns much iia verbal and non-verbal test scoies, 
even for Ameiican childron, seldom corrclntc with one another higher 
than 6 or .7, it is obvious that, although both types of test are called 
‘intelligence’ tosLs, they inoasiiic about as much not held in common 
as they measure of wluit is held in common. Hence, it is not legitimate 
to infer from such data alone that language handicap accounts for the 
low scoics of the foreign children on vcibal tests." 

Although further investigations will bo necessary to settle the 
question, the foregoing citations have some significance May it not 
be roasonalily as-sumocl that soinc peisonahty trait such as effort is 
playing an important r51o? 

Mimions and Puockduuh 

The sclioolfl aelcctod foi making Hub study aic located m mining 
communities of Athens County, Ohio Appioximately ninety-five 
per cent of the workois arc employed in the mines. Under normal 
conditions the ('conomic situation is gcneially good. Duo to a sLiiko 
which has lasted for over a ycai a severo deprcBsion has developed. 
Tor the most part, foreign standaids of Jiving prevail TJio churoh 
and school aro the clui‘f Bourcos of culture. 

The gioups under coneidoiation consist of the ohildien from the 
fourth to the oiglith guide See Table I foi a detailed staioment of 
nationalities Tho.se whoso paionts aic foreign bom conatituto the 
one group and those clnUhen whose paicnls aro native bom make 
up the other grouj) All chiklieii were boin in America, bub the 
majority hear a foreign language at home The pupils of both groups 
are of much the same social status Arlitt® emphasizes the importance 
of taking this factoi into account She finds thoio is a marked differ¬ 
ence in the distiibution of inUdhgence in groups of childicn of the same 
nationality but of a diffeient wjcml level 

It was recognized at tin* outset that tlieie was a selected group of 
natives. Goodoriougli* leinark.s that a person of low intelligence tends 
to gravitate to tlioso neighboilioods wheie the economic requirements 
are minimal; and, once theie, he reacLh lowaid liis sunounclings along 
the line of least resistance Tiom pcisonal observation and inquiry 
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it was learned Ibat no prejudice or ftivonllsin eMsted on tlie part of the 
loachcra. The nutivn and foreiRii were troiUed alike. 

Tlio hearty cooperation of the teachers and iiniicipnls was had 
throughout The pupils mamfested u gieut deal of jiitorcat ui the 
tests by giving close attention to all iiiHtrucliona and suggostiona of the 
examiner.* 


The testa uaed weio tho Otia (llahmlieatinu l'’orni.4 A and B, and 

special teals of the aontenco completion 

and auditory memory typo 

Tatii,h I - Dibtkihutiom op 

NATlONAIil'IinS 

.School A 

NATioriAUTr 

No OP Caber 

Ametvciiu 

05 

llungaiinn 

23 

Polisli 

24 

Ciorman 

0 

Prorich 

13 

Italiiin 

3 

Slavish 

4 

Lilluiaiiiun 

2 

Foreign 

76 

Native 

06 

Total- 

140 

School U 

American 

98 

Hungarian 

45 

German , 

4 

Polish 

1 

Foreign 

60 

Native 

08 

Total 

148 

School C 

American 

68 

School I) 

American 

43 


* Most of tlioso pupils were arrusloincd to tnknij? wlondaulizod tcsls. fi'orm 
A of tho National Intollisoncc Teat and irorms A and IJ of Llic Ktanford Acltiove- 
mont Test were gwcu tho ptccccUng year m an effort to ilotormino tho inllucucc 
of special intonsivo training m 'various school subjeetH While Lho results, wlioa 
considered from tho point of view of tins study tend to confiini. tlio findings here 
reported it has seemed best to omit further monlion 
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Tho general procedure was to administer the fust form of the test, 
then after a period of a few weeks give the second form of the same 
test 

The problem naturally divides itself mlo two distinct appioaches, 
each of which will be considered separately. 


TiiS'i* L’indings —Paut I 

In attempting to deteimine eftort by using tho AQ as an index, 
it was decided that the Otis Classiftcaiion was the best examination 
available, in that, it is composed of both the so-called educational and 
mental ability tests. The finst form was given m January and the 
second in April. The AQ for each individual on each test was derived 


Table II —Tub Median EQ, IQ, and A.Q i-oit tub Fotjh Schools on Form A op 
TUB Otis Clahhipication ITst, amo Quawtile Eangb ron tub AQ 


School 

m 

IQ 

AQ 

Qunrtile 
lango of AQ 

C 

82 77 

8G 81 

96 36 

7 08 

D 

82 01 

80 83 

96 04 

6 02 

A (Native) 

80 78 

8G 64 

99 42 

0 88 

A (Foreign) i 

84 6 

74 8 

103 28 

7 30 

B (Native) 

70 G4 

81 60 

04 02 

6 40 

B (Foreign) 

1 

83 12 

81 30 

100 83 

7 06 


in the way pieviously stated Only losulls from those pupils receiving 
iioth forma aio consideied The different grades m Schools A and B 
were highly comparable in numbers of each sex, and m relative numbers 
of foreign and native 

The reason for giving the two forms was foi the purpose of checking 
the consistency of the two groups in achieving school work within the 
same limits of time 

Schoola C and D woic selected and tested to see if the absence of the 
foreign affected the academic achievement of llie native as determined 
by these tests. 

Table fl gives the median MQ, IQ, and AQ, foi tho different schools 
and groups The (luaiTdo range is also given foi the AQ In Table 
III aio tho same data on the second teat. 

Ill Fig. 1 and 2 are given the cuivcs foi tlie median AQ on the 
two testa for tlio two gioups by grade 
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Table III.— Tub Median EQ, IQ, a‘«» AQ foiitiie Tmhbb Rcuoolb on Fohm B 

OP TUB OtIH CLABRIFfCATlON TehT, ALHO QUABTILB HaNOH FOIl TUB AQ* 





Tables IV and V give the percentage of foreign rpiiclung or exceed¬ 
ing the median of the native. In other worda, tlio nguicB represent 
how many foreign nvo as good as or bettor than half of the native *' 
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If the peicontaKfi is gioater than sixty or less than forty it may be 
considered significiint Rtarcli*® states that any cUfTeiences lying 
between forty per cent and sixty pci cent of the number of cither 


Tatilh IV—Tun Pkiicrntaoe of Foueion ItnAciiiNO on ExonBoiNO tub 
MkOIAN of TIIK NaTIVIJ on li'oilM A or TUB OtIB ClaHHII'TCATION 

'I’rsT 


K(‘l»ool A 


Grade 

4 

1 ^ 

0 

7 

8 

EQ 

33 3 

66 

23 

1 47 1 

BO 

IQ 1 

33 3 

1 06 

30 7 

j 35 2 ' 


AQ 1 

1 73 3 

1 00 

70 0 

1 82 3 

70 


•School li 


EQ ' 

75 

Ml 

40 

76 1 

33 3 

IQ 

100 


23 

60 

33 8 

AQ 1 

87 5 

■■ 

84 0 ! 

76 1 

83 3 


Taiu.b V— Tiik rnucF.NTAfin of Poukkin llnAciimn on Excbbdino tub 
Median or 'run Nativu on Foum 11 of tub O'i’ih (JnAHHiFiCATioN 

'rCBT 


Sciiool A 


Grade 

4 

! ^ 

0 

1 7 

1 8 

EQ 

40 

65 

30 7 

, 41 1 

00 

IQ 

20 (• 

76 

38 4 

17 0 

10 

AQ 

00 0 

50 

00 2 ! 

82 3 

80 

School II 

EQ 


80 

Gl 6 

60 

33 3 

IQ 

Bifl 

60 6 

38 4 

60 

10 0 

AQ 

■1 

100 

84 6 

02 5 

60 G 


group reaching or ('xci'nhiig Llic median of tiiu olhoi arc piactically 
negligible If sixty per cent of one group loach oi exceed the median of 
tlio otlioi it meana lliai ten pin.sons jji a Inindicd of the one grouP; are 
by a small amount suiienor to the otliei 
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TaHLB VI.—TuB rBltCRNTAOK Ol' PfUiRtllS HBAfUINd OR lOxCEBDINQ TUB 
Median ok the Native on I\»hmh A am» IJ ok tub Otib 
Olakhificaiion Tkbt 



Ftinii A 

I'orm H 

All foroif^u HI Bcliool A . ! 

1 


m 1 

; W ‘.i 

r,7 3 

HI 1 

\ 

1 '15 'A 

AQ 1 

1 so 

t 

! 011 11 

All foroign m hcliool 

! 

{ 


KQ 

j m \ 

74 

Ki 

fill 1 

r>H 

A<i 

Kfl ! 


hon'inu HI d mill li: 

r 


vxi 

1 'li G 

6H 4 

m 

02. 

-12 4 

AQ 

i 70 

1 

07 2 

I’AIIT U 


Tlio GOtitral problem i« lioro approucUod from a lUffcrcnt aagle 
than tho preceding cxpcriiiionl Spocuil U'hI« W(;r({ dovised after 
Sonfconco Completion and Auditory Memory IVsts of Otis. The first 
typo of teat is made up of senloncoH from n given story with words 
or phraaca omitted, it ia Uic pupiVa task to fill m these blank spaces 
with appropriate words Uml lie may have a iiitlu'r complete story 
when ho has finished. A hat of possible words follows each set of 
seven or eight sentences l‘’or example: Once wins a toiriblc 

giant ogic. 


pleasantly 

their 

story 

died 


fiercely 

crawl 

terribly 

lived 


there 

Hitting 

built 

pass 


Tho best word is Ihete, consequently it iw jilneed in the blank space 
It will bo recalled that tho socoiul type of lest depends on tiio ability 
of tho pupil to retain and recall ovenU mentioned in a story which he 
hears read. Tor example: Was Gotham known foi its wondrous wise 
men? (yes, no, didn’t say). Tho correct responso is "yuH” according 
to tho story, thereforo this word is underscored. 
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There weie two sots of these oxaminatious’ the first set was given on 
April 12 and the second on Apiil 2G. 


Tadld VII— Mi.djan SroitBS fou tiiu Nativb and Foubign on the Sentence 
C(nii'i,Lrr<iN and Auditohy Mismoiiy Tiistb 



Poicign 

Native 

No of examination j 

1 

2 1 

1 

2 

Completion teals 

Momoiy tests 

12 22 

14 00 

14 

16 38 

HI 

14 26 

14 72 


Perccnlngo of foroiRii loaohnig or pxcopding the modinn of the unlive 


No of RNainiitaltoii 

1 

2 

Complclion testa 

36 2 

41 1 

Mommy tents 

73 6 

73 fi 


The Completion and Moiuoiy Tesls had thirty-five questions or 
statements each. Tlu' score was the numlier iiii.sweicd coirectly 

At the close of tlie (hat lest the pupils were told that in two weeks 
the examiner would be buck to give them a bimilai set of questions 

Table VIII, —Median Scoun voii tjic Native and Portion on the Two 

EVA^flNATIOVH JN THE .SEVENTH OlUDB 



Foieign 

Native 

No. of examination 

1 

2 

1 

2 

Completion teals 

Memory tests 

12 

13 86 

14 10 

10 26 

17 

16 26 

17 6 

10 26 


Pereontago of foicign ipfieliing or pxcpcchiig the inodian of the native in tho 
seventh grade 


No, of e\ainmatii»ii 

1 ^ 

2 

OomplctUMi tests 

37 6 

02 6 

Memory tcslH 

43 7 

02 6 


and incomploto bontcnces They weie advised that tho stones from 
which these Losts would lie compiled were to be found in specified 
books in their library, and that fiom the six stories the names of which 
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wore placed on the hoard, two would k*ivc as the l)asi3of the ficconc) 
examination. No fuithcr 8URK«*‘^t»t>iis won* Rivon. 'J'lm Iruchorswere 
requested to make no furlher montum of Hie avoiIc. 

Table VII Rives tliu lesulls for the Iwo Rioups in llie two cxaminn- 
lions Table VIII Rives the leHulls for lh<‘ Iw'o Riniips on the two 
oxammalions foi llie seventh Rinde, the leiison forseleclniR tliis partic¬ 
ular Ri'fldu biMiiR Ihal theie weie the snmi' niimlier of the foreign 
and native 


DIvSCUSSION and (lONCMimoNH 

Wlicn Coiviii*^ compared the scoiea ouiiied, on the Otis Gioiip 
InLolligcuce Scale, Forms A nml B, by cliddien of Hronkhne, Mnssa- 
cliusotts and Cincinnati, Ohio ho found the Inttei to 1 m‘ infeiior lie 
attributed this infenouty to diffeioiicos in oppoilunil les to learn words 
and acquire skill in Lkoir use He suppoilcsl his conclusion witli tho 
fact that tho cluldrfsn lu tho jioorer lociiblu-H in Hrooklino did not 
score ns high in the entire test as di<l the childien in llie more favored 
localities In tho Aritlimotio lest “hiigeli' non-veiiial in its nature" 
the scores were not infonor to those made by tlie children in the bolter 
scoiions. 

Tho results of our own study would seem to mippoit Colvin's 
contention. Tho scores on llie entire teat weie lowei timn tho estab¬ 
lished nouns llowevci, upon a caieful examination of the Aiitlunc- 
tio problems of the OUh ChiHsificiilioii it was found Dial both gioups 
did equally well. In view of this fact it is apparent that Imth gioups 
weie competing on an aiipioxiinately eijual Imsis with reference to the 
language factor. In no case was it discovcied that the foioign weie 
moio handicapped Iniguistieally than the native 

From Tables II and III it may be observed that iii all cases the 
foreign mako a higher inedimi AQ than the native. It is Hue that the 
native make a higher IQ but the dilToieiicc is ho slight that wc can 
attach little, if any, signlficiince to it 

Fioin these results it is evident that the native au* more highly 
selected than the foioign, tho quaitilo laiige in AQ is gieatcr foi the 
foicign gioup. Inspection of fietiucncy distribution tables also shows 
greater variability The selection of the native is (‘mphiisis'.ed liy the 
fact that nearly fifteen pci cent of those taking the lirsl Le.st liad moved 
from the community by the time of the second I'bis accounts for 
the kinitccl number of cases in the study, us wo eonsidcred only those 
pupils who wore tested both times 
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The schools in wliich no foicign wcic found, tested on a par with 
the other two sclioola. That there were no foioign in Schools C and 
D was learned fioin quosUonnaires filled out by the pupils and con¬ 
firmed by the teacheis An attempt was made to get information on 
the different grades with lefcicnce to median AQ. Figures 1 and 2 
show a gicat deal of nucLuation, but it will be noted that the foreign 
and native gioiips align Ihomiscivcs m enivcs exhibiting marked 
consistency. 

The eighth grades of Schools A and B were vciy small Table 
IV and V present data which might lend one to conoludo that the low 
IQ of the foreign was lesponsiblo for Ihoir high AQ. Whore this 
difference occurs the probable explanation is the smallness of the 
class. 

Table VI shows the percentage of foieign roaching or exceeding 
the median of the native to be at least significant. 

In approaching the problem by the second method, the Special 
Completion and Memory Tests, it was assumed that the group showing 
the most improvement would bo putting forth the most effort. This 
assumption could bo reasonably juBtified on the basis of the preceding 
experiment. Tables VII and VIII would mdicato the foreign to be 
superior. Inteiosting details in connection with this second experi¬ 
ment are: Of aovcii who wore effortful enough to road the stories for 
the second examination, five woic foieign; Die coi relation between 
the two cxnrainatioiis was 79'! with a Pltl of 032 

Our study may have something in common with an mvcstigaiion 
which has been ciuried on by Millei“ witli fieshman onginceimg 
students at tlio Uiiivcrsity of Michigan ^'Thc low students arc, in 
the main, children and grnndchiklicn of Amorican-born men and 
women. They also aic the sons of the bcttci educated and moic 
prosperous parents. A surpiisingly large pcicentago of the high 
students aie the grandsons of foieign-born men and women They 
are tlie sons of paients having little education or none In the main 
they aie the sons of paients whose education does not include the 
high school Twonty-foui pei cent aio the sons of paients who had 
leas than a gnviiimiu' school education ” lie fui’Lhoi states. “Low 
students are lacicing in tlie quality of vision, poweis of analysis and 
cooidination. 'I’hoy me siiperhcially bright and ingenuous, but thcii 
tenaciousiK'HS of puipose an<l capacity for sustained mental effort are 
so low that thoir curve of effort hn.s ii .steadily downwaid trend ” 
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May not tho abovo discussion and our findiiifz;8 suggest a possible 
and partial explanation for the pievnilmg opinion of tho thrift and 
rapid economic rise of the foreigner? 

Some conclusions to be diawn fioin tliin study may bo briefly 
stated as follows: 

1. Groups of childien of f()i(*ign-boi« paients arc coiiBistcnt m 
making liighcr incdiiin Acliievcmciil Quolients than nro gioups of 
children of native-bnin piirents 

2. In most caseH the tiiedinn Intelligence (Juotient is slightly 
higher for tho gioups of native children than for tlie foicign. 

3. Both gioups woio haiulicappcd in the use of language as meas¬ 
ured iu nil tho teals. 

4. The foreign have little or no lulnbiting oi unfavoralilo influence 
on the scliool progre.'iS of the native. 

6. By the use of olijeclivo loalu the foieign jirovo themselves 
superior to the native in effort The relative significance of this 
personality trait is at least miggosLed by the manner m winch tho 
foreign overcome obstacles iii making new ndjuslments 
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THE EJHi'ECT OE THE FORM OF A OOISIBINATION 
IN THE LFAllNIN('r OF A MULTiriAC^ATION TABLE 
BY BRIGHT AND DULL GHILDIIEN 

T. Wn«SON 

iSt/vlo Teiu’Itcru TJnffnlo, Now York 

In an oxpoiiiTionlul Bliuly lopoiUkl ols('Wh(‘r<^,' HCilcntocl Rioups of 
fifteen cUildicn oacli, learned a mulUplicaliou werioH fiom 2 X 07 to 
9 X 07, inchisivc. Practice wn8 provided liy a raid, upon which the 

67 2 

eight combmatioiifi apiioaifid in both vertical forniH, that is as 2 and 67, 
with the answers given at the bottom of the caul in both horizontal 
forms, that is, as 2 X 07 = 134, and 07 X 2 = 134 The children 
read the combiiialioiis above orally, and found the answera by looking 
belo^Y and giving them eially. The subjeeta weie selected by individ¬ 
ual teat witli ilio Stunfoid Revision of tlio Binet and liy clironological 
age. Half of tiiein were practically nine years old and lialf twelve. 
Half of each of these ages weiii of ICVu between eighty and ninety, and 
the others hotweoii one hundred ton and one biindred twenty Full 
description of the subjecti and the tOchinqiie of the experiment arc 
given in the refeieuco cited above 

The tabic shown herewith gives the lecord of (he eoircct answers 
of each group A sinking likeness is seen in iioarly every pair of the 
combination forms. In only four wises aro the diffei (mces in the scores 
of paiis more than five. Invoaligaliim of the do tailed records indicates 
that these are puioly chnnee lesullH, expliiiiuible m the small number 
of responses in ccitam instances and the cumuliUive eiTocL of very few 
subjocLBin small senres 

The mam point of mteiest m those data sec'in.s to lie not so much 
that, in learning the answers, the two foiins of iin aiithiiietic combinn- 
Lion arc of no particular difference in diirieulty, as that there bpcm to bo 
no distinguishing differences in that rogaiil lictweim children of rather 
low mental ability and othois of lathcr lugh ineiUal ability In 
effect it seemb to suggest that the leaining piocess, wluitovcv it may bo 
in ultimate elements, is much the Hiimo for dull and linglit. This is 
supported by other evidence in the liible not stiossed in tins report 
because it has been ti'cated moic eUendedly elsewhere', miniely, that 

> Wilaon, F. T.* “The LcarninK of IlriRlil nnd Ihill Children'* Tcaclicra 
Collego Contributions to Education, No. 292, 1928 
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the combinations which were haiclcst for the bright weie also hardest 
for the dull, and that the combinations easiest for the dull were also 
strikingly easiest foi the bright. 

Thcfie pomia tend Co turn the luteiost of those concerned with the 
guidance of loainiiig processes of human beings to two concepts said 
to bo at iireseiit of some psychological repute. They are, first, that 
human beings, despite gicat variations in abilities and interests, learn 

Tablb I — NoMnon of ConiiRca’ IIbbfonsbb to Each FonM of the CoMBiNATiosa 
BY TUB Dunt^ AND BnionT Grodps 


Combinations 

Dull 9 

2 X 67 . 

21 

67 X 2 

22 

3 X 67 

31 

67 X 3 

20 

4X07 

1 

07 X 4 . 

0 

6X67 

48 

07 X fi 

44 

6X67 

28 

07 X 0 , 

28 

7 X 07 

0 

07 X 7 

0 

8 X 07 

7 

67 X 8 

7 

9 X 67 , 

20 

07 X 9 

31 

Total 

312 



m much the Biiino way one to anotlici. Theie are differences m rate, 
accuracy and letcntivcncss of Icnining, but basically thoie seem to be 
conditions and piogvesH of like kind The feccond concept is that a 
Icainmg task sucli as LIub is attacked and pi ogress made in iL m a way 
which suggests the unity or wholeness of the entire matter, rather than 
a separateness of pai Is Grasping the plan of the task, as expressed 
in an answer, the mind acems not to be disturbed, perhaps, by the 
arrangement of pai is, but seeks to handle the maicnal as a whole 











STXIDy HABITS OB TKAfTIKKS OOTXKCiK STUDENTS 

nUCill M IJKLL 

Htfilo IVorlirrH (Villrgo, (Jliirfi, ('nhf. 

Tho quGBHon of the iiiiiouni of tmio Kivon l<> Hiudy ir of importance 
to both the Btudent and to the lulininiRtrator. Htiulijiitfs in a teachers 
college, piopanng to guide olliorfl in learning, need oHpccially to 
dcmonslralo to IheinsrWra lelalionabip whicli rxiHls between their 
study habits and their scholasliR uchicvcinent Fioni the adminigtra- 
tor’s standpoint anything nppioacliing successful student guidance 
cannot bo ntlainod without <l(*limte infonnatioii m regard to study 
activity and the relation it beutfi to intelligence and scholastic 
standing. 

In tills investigation we Koughi to answer tlic.^e, questions: When 
do students study? How long do they study? Wlmt is the nature 
of their study activity? How is the amount of study time related to 
intelligence and Rcholarship’ 

Students m Genoial ami I'hlucational Psychology classes were 
used as subjcols, Tho luveRtigaUon was cnndiiotod dunng the school 
year 1928-1929. A total of ono Inindred tweiUy-seven stvulenls kept 
daily records of their study lime for twenty-eight days According 
was not begun until after tho third week of each semuhter. Keeping 
the records was considered a pait of the regular work of tho courses, 
Every effort was made to secure the cooperulion of the students since 
this typo of mvcsligalioii depends so much upon it. Tho instiuctor 
took onc-half hour of tho period on tho day that tho rocord blanks were 
given out to explain the purpose of the investigation and to .show them 
the importance of keeping the recoids carefully Eaoli succeeding 
week whon new blanks were given out the studonla wore again urged to 
keep the recoida faithfully. 

Tho study lecord coimisled of a apccinlly piepaicd sheet on which 
columns wcie provided wherein the Btudout recorded each day’s 
study activity. Tho atudenls were given HufRcicnt record blanks for 
one week, At the end of the week they lunipd m their records and 
got a now set of blanks. Columns wore piovided iii whioli tho students 
could record the following information: Time of stuily —tla' day of tho 
week and whether it was done in tho morning, aftornoou or evening, 
type of study—whether reading in a textbook, oiUsitlo reading assign¬ 
ments or written work such as themes and pioliloms. 
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The study day was divided into three poiiods: Morning, from time 
of arising until twelve noon, afternoon, from twelve noon until six 
o'clock; evening, fiom six o’clock until time of letiring. 

Duiing the school year all the students were given the American 
Council of Education Psychological Examination Rcpoits wcie 
secured from the regisliaia office of the grade points earned by each 
student in all subjects foi one somcslor. Coirclations weio computed 
between atudy time, scholurship and intelligonco. 

Results 

From analysis of tho 355G days of study reported by the group, 
as shown m Table I, thcie was a total of nearly 396,000 minutes, 6683 
hours, given to study by the entire group ovei the period of four weeks. 
This would bo an average of one bundled eleven minutes, oi just short 


Tahms I —Timd op DAif WiiBN Study Was Dond 


Tiino of (lay 

Number of 
mmutes 

Per cent 

Average numbei 
minutes poi 

1 Btuilcnt, per day 

Morning 

0(1.493 ■ 

1 

24 ’ 

27 

Aftornoon 

126,107 

32 

36 

Evoning 

173,848 

44 

40 

Total 



111 


of two houis per day for each student. Twenty-four per cent of the 
total study woik wna done in the morning period, thirfcy-two per cent 
m the afternoon, and forty-four per cent in the evening. The results 
indicate that ncaily onc-Iuilf of the students’ studying is done in the 
evening by artificial light The average numbei of minutes per student 
per day for the moining pciiod is twenty-seven minutes, for the after¬ 
noon thirty-five minutes, and for the evening pciiod forty-mne 
mmutca Thcftc averages assume that all atudenta studied on each of 
the twenty-eight days that the investigation coveied 

A companson of llio study activity on the vauoiia days of the week 
IS recorded in Taldo II. The number of minuLes lecordocl for any 
given day is tlio sum of all the study time repoi ted by all the students 
for that day. Thcio is a gradual iiicroaflc in Lho amount of study from 
Sunday to Tuesday where it begins to diop off to Thursday. Fiom 
Thursday to Sunday theio is a pionounccd diop The most outstand- 
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ing dvop 18 fioui Tlivu-wUiY lo iMuUty wliou Ich« time \va8 given to 
study tluin on luiy olluT chiy of tlio. week 'L'lui dilTorcncG between 
Saturday and Fiuluy ih not M inueli ns one ijukIiI Iwivo Hupposed. 

In the second column of this lalih* the averngo numher of minutes 
per day for each Hludimt is jcporled In thoKe iwemgc's the actual 
numiior of AtudontH Htudying on a given day is lulcon into coriHidcrntlon 
In Table I wlicie tlu‘ number of Hliidenls htndying on a given day was 
not taken into account, it iippmired dial, on (he iivm'iige, our students 
wore Htudying one houi and fifty-one iiuiuUeH per day. In Table 
11 those who did not study wer<* ehniiiiateil from tho averages and 
the mean incieascd lo two hours and lliirleon minutes. 


Tahlr II—C'oMi'AiiiHON Of .Stmut A<’Tivity OS V'akiouh Pays oif thh Werk 


Pays of week 

, Nuiidict of 
iniiiutcH 

' Jlailyuveiagi’, 

1 miiutjcT of 
miiniU'H piT 

Nliuleitt 

Numlier of 
xludenU 
sliulyiriR 

' Per cent 

■Sunday. 

BHBIm 

128 

:h;i 

07 

Monday 


HO 

■170 

04 

''L'ucsdfty 

HS.'lKR 

lOK 

605 

00 4 

Wcdncfiday 

72.««I 

I'lK 

<188 

00 

Tlmrsdny 


140 

■100 

07 0 

Friday 


02 

;i7'l 

73 0 

■Snlurday 

26.217 

no 

213 

41 


The number of studoiUa bludying on a given day is reported 
m column tlueo of TabU* TI, This K?prcM*n(H the total for the four 
week period Thus if all the Hludeids had studied on a given day the 
Number of Studoiils Biudying would have been five luindrod eight since 
there were one liundicd twoiily-M*ven sludenls who kept lecoiclsfor 
four weeks. In the fouilli coluinii Uic per cent of studenls Btudying 
on any given day is sliown fii genoial tho nuinlu'r of students study¬ 
ing shows about the same tendency lo mcii'ane or decrease that tho 
number of minuLo.s shows However, tlieie lue iriteicHting exceptions 
to this. Tho number of students engaging in study increased from 
Wednesday to Tliuiflday, but (lie duration of the study peilods 
docieaacd. There, is a greater number of atudents studying on 
Friday than on Sunday, Init tlio (olal nuinlier of minutes given to 
study on Sunday is twenUy-four per cent gieiiter than that on Friday 
There is a goneial tendency to doovease the length of the study period 
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as tbe wGok-end approaches A comparatively small number of 
students, forty-one ppi ccnl, arc studying on Saturday, however, their 
study activity seeniH to bo of a better quality than Friday’s in as much 
as it is earned on for longer periods of time Both fioin the standpoint 
of the numbei of stiwlonls studying and the average length of tunc 
given to study, Tuesday tends to be the best day of the week for study. 

Book/ in a i(‘(!ont investigation of lotuliiig among college students 
states that if. has been estimated that the aveiage student gets ninety 
per cent of his infoimalion in college horn some type of reading 
activity In Table III evidence is presented which nppaicntly sub- 


TaWiB III —CoMl'AUlHON Ot AaWUMP OF I'ltm tilVilN 'TO RBAniNQ AND WhITINQ 

IN Study Activity 



Rending nctivilios 


Writing activities 

Textbook 

Clollatoral 

Piobloma 

Papers 

Number 

minutes 

pci cent 

Nnrnlicr 

imnutps 

Per coni 

Number 

minutes 

Per eoiifc 

Number 

inmutcs 

Per cent 

100,886 

63 

1 30,5:i0 

1« 

1 13,662 
l 

j S fi 

14,280 

1 0 5 


atantiatcB tins osLiinaU* Not all Lhp students signified the type of 
study, whether leading oi wilting, and hence oiii data lepicscnt the 
reports of only those who did. The total number of minutes foi those 
students who signified the type of study was 159,257. Of this, sixLy- 
threc per cent was given to loading textbooks; nineteen pei cent to 
leading collatoial material, 8 5 poi cent to working piobloms; and 
9 5 to writing [lapers and Ihoinos hliglity-lwo per cent of all the study 
time was used in some type of lending activity and eighteen per cent 
in willing wojk This is, of couisc, only a lOugh esLimato since some 
types of study aic ddlicuR to classify under the above headings 

Since some students cany lieavici scholastic loads than others it was 
necessary to devise a inoana of cqualisung this difference before deter¬ 
mining the average study tiino foi a given student to be used m our 
coirelatLons This wan accompliKlicd by finding the average number 
of minutes per w(*ok spent in study and then dividing this by the num¬ 
ber of units 01 houra can led foi the eemesLor This gave the numboi 

' Book, Win F , Ilnw Well (ioHeRO iStiuh'iita (Jan Head School and Society, 
Vol XXVI, AhrusL, JQ27, pp 242-248 
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of minutes stutlieil for iv Kivcm hour of hcIiooI work Courses which did 
nob require prcpariition, such ns iihymoni t’lliication activities, were 
eliminated. When the Htudeiil’Hgnulea iin<l.study tune were correlated 
the Pearson r was -l-.mV i .05. Tin* coofiicicnl, wlicn grades were 
correlated with mUdllgcuce, wus d-.fiOh h til. Iiitolhgvncecorrelated 
with study Liinc -H.OOi? + .00 The tiist two {•oenunenls are approxi¬ 
mately tho same as secured by Muy' in iin (*urli(‘r study of this same 
oliarttcter However, he secuicd ii negative coireliiLiou betweea 
iiitoliigencc and study lime Using llie pm (ml conchition method and 
bolding intolhgoncc constant, the eoiielaluin between study lime and 
scholastic standing is -{-.3112 ± 05 

From these coenicionls it would seem thul tho mlelligenco lest was a 
better indicator of schohiKtic success (luui Hludy tune. Iiitclligonce is 
not dofinilely related to wUidy lime .muee tlu* student with a high or 
low acoro la an liitcly ua not to study n long or nbort pouod of time. 
This la ilUistraled by refereiico to an mdividiml cuho. Two students 
who Blood at the ninely-eighlli percent ile in Die intelligence lest studied, 
ou tho average, si'ven minutes, uiul four houiH and nineteen minutes 
per day reapcotively. Tlie Htudont whose Hiudy time was sovon 
minutes por day made a () average in lier courseM. The otliur student 
had a straight A average. 


HUMMAln 

All inve.sligation was earned on wiDi one humhed Iwenly-sovcn 
teachers college .■itudents of fiehliimin lo wmior Kliinding to analyze 
the time factor in sliuly and to relate it Ui intelligence and scholastic 
etaiuUng, The following pomta of uitevesl have, appeared. 

1. Approximately one-half, foily-four pt‘r cent, of the etiulcnts' 
study is cairlcd on in the evening by artincial hglil. 

2. Tuesday Lends to be tho day on which the most studying is 
done; Friday is tho day when the least studying ih done 

3. Sunday is a bettor study clay tliun eiDiei Fiiday or Saturday, 
judged m terms of amount of limo devoted. 

4. Tlio average daily study lime fm the eiitiie group was one hour 
and fifty-one minutes. When tlioHe who dul not study on ii given day 
are eliminated this avciage rises lo two Iiouis and thirteen niinutcs 

* Sco Mfiy, Mark A,' Ficdiulitig Arailpinio Kuccoss Journal of lidiicalumal 
Psychology, Vol XIV, 1923, pp 420-440. 
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5. Towards tlio end of the week there is a pronounced tendency 
to shorten up on the duration of the study periods and a less pronounced 
tendency for fewer students to he studying. 

6 Sixby-sevcn poi cent of the students studied on Sunday, ninety- 
four per cent on Monday, over nmety-mne per cent on Tuesday, 
ninety-six per cent on Wednesday, ninety-seven per cent on Thursday, 
seventy-three per cent on k'liday, and foity-ono per cent on Saturday 

7. Sixty-thveo pei cent of the students’ study time was given to 
reading textbooks; niiiGlcon per cent to outside readings; 8 6 per cent to 
working problems; and 9 6 per cent to writing themes and othei 
papers. Eighty-two per cent of the lota! time was used in reading 
and eighteen pci cent in writing. 

8 Study tunc correlates -I-.317 ± .06 with scholastic standing, 
intelligence con elutes -[-.605 ± .04 with scholastic standing; and intelli- 
genco correlates+.003 ± 06 with study time. With mtclligcnce hold 
constant, study time conclatcs + 382 ± 06 with scholastic achieve- 
raent. Intclligoiico appeals to bo a better indicator of scholastic 
success than study tunc 



CONSTANT CIIANCJKS IN TJIK STANFOUD-BINET IQ 

PSYfniK fJA'rj'KLL 
ITnrvnnl llnivpmly 

The Harvard UnivciHily (5ro\v(li Sludy, wnducfnd by Professor 
Walter I*\ Deuihorn, in now m ifn niiUli y('ur J'^acli year some 
one hundred fifty to two thooHand of llir olnldrnn luivc been given 
an ludlvidual t^tau(oul-Bu\ot \nlclhp,vttcc vxuuunation. By tha and 
of the seventh year two or more Bincl. Iti’H liiul ))cen secured for 
one thousand one hundred eiKlily-llirrc' pupils. Tlieso one thousand 
one hundred ciglity-lliree Hubjools were divided into groups according 
to the period of tune that had elapsed liotweoii the first two 
Binet examinations: under llircc inoiitha, three to six months, six 
to twelve, twelve to eighteen, oi^^hlcon to twonly-four, f.wcnty-four to 
thirty-six, thirty-sK lo forty-eipiiL, forty-eight to sixty and sixty to 
SGVonty-two ^ 

The median amount by which the M*nond I fell sliort of or exceeded 
the first 18 sliowji in Table I. It appearri juniiiibh* lliat the median 


Tadlb I—Mrdian Binkt KJ CirAsoEH Abrrn Vmiunu Intkrvai.s or Time 


Months l)fitwccii tcala 

No of (‘niii'A 

j Median 

1 difTerenceK 

1 

PE 

0- 3 

lA 

d T 0 

il 1 

3-0. . . 

64 

^h3 S 

! ±0 a 

0-12. 

! 30« 

H-0 2 

iO 4 

12-18 

174 

-t-2 0 

±0 0 

18-24 

04 

-0 T) 

±0 0 

24-30, 

02 

-n 2 

±0 0 

30-48, 

203 

-2 7 

fcO 4 

48-60 . . 

G1 ' 

-1-1 0 

±1 5 

60-72 

320 

-0 1 

±0 4 

0-72 . . 

13B3 

-0 02 

±0 22 


gain of fiO points in the group repealing (he tost within a period of 
three months and of 3.8 when lepoaling it after a pmiod of from three 


^ It was found that tlio effoot of <li(i not (’an V nvci oiglilrnn inontha, 

fchoroforo a child that lin<! been givna Bovrnd IphIh wan iiHcd Jii inoic than one coin- 
ptvtiBOU provirioil that t\o ti'st had l«'m rivpii iM'twcen \ be two c(»mj)ared ot 
wilhm a period of IR monUiH preooding Ihn lirat. 'I'lnn jnin'ciline increnHed the 
mmibor of coinpansona by two hundred bniiKniK llm total up lo one tliousond 
three himdred olghby-thrco. 
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Comlani Changes m Sianford-Binei IQ 

to six months icsuUcd Eiom llie c\pcnenco gtimod during the first 
testing. There, however, appeal’s lo be but little, if any, practice 
effect resulting from a teat taken more than six months previous. 
The group of one bundled seventy-foul* cases with an interval of 
twelve to eighteen months made a median gam of 2.0 points, bub the 
three bundled eight cases with an interval of C to 12 months showed a 
gain, of only 0.2 of a point, fioni eighteen to twenty-four months 
there was a loss of 0 5 of a point 

In an earhei study it was found that at the upper levels of mtelh- 
gonce certain group tests gave unifoimly higher and others uniformly 
lower IQ’s than the Btanfoicl-Bmct * The question aiisea as to 
whether this was caused by vaiiations in the standaids of one or both 
tests, by factois inherent m the test items, or since the group and 
individual tests were not always given m the same yeai, whether there 
was a real change m the iclafcive intelligence level of the child. 

When coinpanng the gams and loses of Sfcanford-Binet IQ’s of 
blight and dull children, Oarii&on wiitcs* 

Since there docH Rocm to be a slight gam m the higher clnssca, it is evident that 
there is a slight pitietiHc* effpot, that the test is relatively cnsiGT in the higher ages, 
or that the IQ actually mcicnBos for the higher closscs Wo feel that there are not 
enough data available yot to warrant dolinito oonclusions ^ 

Rugg and Carlton state that, 

Dificrencra in rotrata will be approximately thcaanic, nieapeative of intolhgeneo 
of the pupil.* 

And Termnn that 

. . the IQ roiiunns nlinost eqiiallv oonstant for the three groups The 
greatest tendenoy to gain uppeais with the avciagc gioiip and the next greatest 
with the dull The diffeieiici'B, howevoi aic practically negligible It makes 
little diffcronco wlietlior llio child was blight, average, or dull, how long an inter¬ 
val separated tests oi whnt iho ago of the cliild was at the earlier teat ^ 

Each limc-intoival gioiip was ledividcd into thiee IQ levels accord" 
mg to the avciagc of tho Bind IQ’s below ninety, ninety to one 

* Cattoll, Psyche Conipniahihty of IQ’s Obtained from. Different Teats at 
Difforont IQ Lovcls ,Hchooi and •Society, March 20, 1930 

“ Clftrriflon, C S Additioiml Retests by means of tho iStiiiiford Ilovision of the 
Biiiot-Biinon Ti'sls Jomtud Jiducnltoml Piiycholooj/, May, 1922, p, 311 

*lUigg, Iluiold 1111(1 Cetilo Collolou CJonstaiicy of Lho Stanfoid-Bmet IQ ns 
Shown by Iletesls Jonninl Kducalxonnl Psychologu, Sept, 1921, p 320 

^Tcrmaii, Lewis M “Tlio Intelligence of School Chikbon " Houghton 
Mifllin Co , 1010, pjj MO and HG 
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hundred nine, one liundi(*<l l<*i» aud hi^lior. '['lie median of the 
difTercLiccfl of each group are plolled in lug 1 Tin? firat bar of each 
group represcnlB tlioso with Hi’a below ninely, the second those with 
IQ’s from ninety to one hundred nine and third those of one hundred 
ten and above The aniounr iiy wliieli the inedum child’s second 
IQ fell short of or exceeded the first ih given on the vertical scale, 
For example, in the Hocoial gioup in winch Die time between the two 
tests varied from six to twedve inonfliH, tin* inediiui pupil with an IQ 
below ninety lost 1.4 points, the inedmn of those of avorago ability 
gamed 0.1 of a [loint and the inedmn of lliose with ICJ’s of one hundred 



Fiu. 1 —MoUiaii oUauKcs lu Uio Hmot IQ a( dull awruRU uud brlRUl imaila nftor vary- 

iiiK IiiUtviiIm of (inio. 


ton or higher gained 0.2. The naim* data are giv(‘n in tabular form 
at the foot of the chart, the first niw give.s t lie median of the differences, 
the second the number of eases nnd the IhiHl the lime interval between 
tho two tests 

When the tests were repealed after an intcival of less than six 
months tho median IQ of the pupils at all (hieo IcvcIh of intelligence 
showed a gain, probably duo, ns Htalod above, to tho effoet of piactice, 
The average group gained slightly moio than oitliei the bright or dull 
group, but tho differences aic too small 1o bo of .significanco. As the 
time interval between llio IohI.s m inci'cimod lieyond eighteen months a 
tendency for tlic low IQ's to docieu.se arnl the high [Q’s to incicnee 
becomes evident. ‘ The further apart tho two (ehls tin* more marked 

‘ Whon a oliild pnsaed a total of five or nicno Irsta in yi'iirw Hivtocii and oightccii, 
ProfosBor Terman'd eorrcelion wniiniiplii'd to the nn>nliii aK» (dciuitio Studios o( 
Gcniua, Vol. I, p. 42.) Smec only afow of Uh* cliildn'ii weio ovci fourLooii \ cars of 
ago at tho time of the last tost, the majoiity lioniR imdoi tliiitcon, tlio coircclion 
was needed in only a small proportion of the cusps 
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is the tendency. 'When the last two groups are combined it is found 
that the median loss of the eighty-one cases with IQ’s of below ninety 
was four points wliilc the sixly-onc cases with IQ’s of one hundred 
ton or higher gained seven points The median change of those of 
average intclhgonce wns only one-half of one point. 

The tendency for the low IQ's to lose and the high IQ’s to gam is 
shown oven more clcaily in Fig 2. All llic.so cases in which the interval 



between the two fitanford-Binet tobta was ovoi thice years were 
placed in one group and those with an inteival of under two years 
m another Within each group the subjects woie divided into ten 
point IQ gioups, leaving those below seventy in one group and those 
above one hundicd forty in another The medians of the differences 
between the first and second IQ of the pupils icpeating the test after a 
period of from Ihieo to six ycais me lepiesnntod by solid bars connected 
by a solid line. The (eiulonoy for the low IQ to become lower and 
the high IQ to become highoi ih iiuukod The lowest group lost 7 6 
points, tlio highest gaim'd Ki 0, while the medians of the changes of 
the remaining gioups ranged between these two extremes 

The median of tlie chlTorenccs between the first and second IQ 
of tlic groups taking the two tests at intcivals under two years gives a 
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differnriL pictuir. Tlioy uu* rcprcWMitcd in ylunU'd IniiH connected 
by a broken lino in Fig. 2 No gioiip had u inediun change of more 
than 1.5 points with llie eveeplion of tlie gioup below Hi\ty IQ and the 
one above one hundred forty. Theic are undudod t’evenly-lwo that 
took the tsvo tCHlH within a period of wv inonlliH Tlie effect of 
practice earned ov(*r to the M'uoiid teal, in lliese emsen is probably 
suflicicnt to account for the tif Himill g»in‘j over hivscs in the 

interinediato gumpH The loweal gioup only eoutiuiiH eleven cases 
and the gains of foui points may well he du(* to eliance eirors, The 
gain of nearly nmi* point.s in the group of eighteen cases with IQ's 
of one hundied foily and above is not m) easy to explain, it may also 
be due, at least in jnut, to chance erioia, or it may be that the effect 
of practice i.s cairii'd ovm a longer periotl in the oa.se of exceptionally 
bnglit clnldren tlian it w among oilier children (only three of the 
eighteen ciiseH weie leleKied witliiu ii peiiod of leas tlian six monthb). 
Finally it la possilile, though it doea not Hewn probable, that the lolativc 
mlclligcnce level of the gioup wasuetimlly lametl dining the short time 
between Iho tests. Moio (Imn one factor is piobiildy involved. 

Thoic is, of couibe, a poRsibdily lhat home of <h(‘ cliangcs in IQ 
aie cauacd by variations in the teat era Vifty-Hoven diffoientexannneis 
took part in the testing, All wen* insliuelois, asHiHliinls or graduate 
studonta m psychology or education at Harvard Unweiaity. How¬ 
ever, the general trend of the cuivc's is too leguhir to be explained 
away by chance errois in the wimple or by the pmsonal oiiuation of 
the examiners, it is more hkoly that huch eriois me responsible for the 
iriegularitio.s m the general trend. 

'L'he cause of the gain of the high IQ's anti the loss of the low is 
not clear The factor of pTiiotice in ruled out by the fact that the 
greater the time interval between the tests, the gioator the gam of 
the bright pupils, and tbo fact that the piipiia of low iiitelhgcnco lost. 
The gam in the high IQ’s would bo accounted foi if Llio upper testa 
on the Bmet scale wcio loo easy, but the revorso has generally been 
supposed to be true and, in any cu.se, tins would not explain the loss 
of the low IQ's. It may be that the bright cliild has, or finds, more 
opportunities to aoquiio that typnuf infonimiion winch aids in success¬ 
fully passing the Binet tesla than the older child of the Hiuno mental 
ago. The greater interest in leading of the bright cliild and the lesser 
interest of the dull cliild uiny bo n factor. 

If there is a tendency for the rnngo in IQ's to incieuso with age it 
would be Buf&ciont to account for the median incroase of the high IQ’s 
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and the decrease of the low IQ's. This scorns to the writer the more 
probable explanation It is, of course, well known that the range of 
the distributions of heights and woiglits of children mciense as the 
age incieasGs, also intolhgcncc when incnsuicd in terms of raental age. 
Tlic theory of tlio constancy of the IQ is based on the assumption that 
though the intclligonce of tlie bright child mcieasrs at a greater rate 
than the dull clnld, iliat of l)olh Uic blight and llio dull child remain 
constant m propoition to his chronological age. A clnld that has 
a mental ago 20 per cent above hia chronological age at school entrance 
would maintain the same propoilional diHerencc between his CA 
and MA throughout the period of giowtli Although the difference 
between his raental and physical ago would racreasc, Ins IQ would 
remain constant. 

The present findings indicate that those pupils that start school 
with IQ's above the aveiago, not only inoicasc m mental ability at a 
rate sufTiciont to keep the proportion between the life and mental age 
the same, but at a moio rapid rate, causing the IQ to rise, while the 
dull child's mental ago falls lelativcly to his CA, causing a drop in 
the IQ This is contrary to the findings of Terman and of Rugg and 
Carlton quoted above but is corroborated by Garrison who finds a 
slight increase in the highoi classes nncl with Cyril Buit, Doll and others 
who have found a dcoroase in the IQ of sub-normal children and with 
Kuhlmann who writes that. 

It h«s boon known for some time tlint tlio IQ as found by tests that give 
correct mental egos at all mental levels docs not remam constant throughout suc¬ 
cessive years, except for cliildren with on initial IQ of 1 00 Initial intelligence 
quotients below 1.00 tend to decrease, and above 1 00 they tend to mcreaeo as the 
child grows older ‘ 

Freeman in leferiing to sub-noimal childien makes the opposite 
statement' 

Wo may expect backward childioii to gam about aa much from yem to year 
and to contimiQ to gain about ns long ns normal children or bright children,* 

This would mean a maiked increase m IQ of the backward children 
as age increases. It appear.?, howevci, from other statements made 
by Freeman that this la ii slip of the pen and that what ho had intended 

' Kuhlmann, F. and llo^io Andoiaon “The Forthcoming Revision of the Manual 
of Instruction for tlie Kuiilmann-Anderson IntoHigencc Tests " The Educational 
Tost Bureau, Mimicapolia, Minn , p 118. 

* Freeman, I'ranlc N. “Mental Tests’* Houghton Mifllm, p 357 
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to write was piobubly that lht‘ duil clubl contiiuiod to f^row na steadily 
luul for ns ionj> ii liino us tbo norinul and bii);bt cbild, \)ut at a slower 
late. If (Ins lio llus coriccL inlcrpiclalion be is in iif^recmont with 
the view licUl by 'J'oriiiun and bm followerH 

(’ONCniWUlXH 

1. When a i^tanford-lluiet Ii'mI Ih rc|H'iilrd within a iieriod of three 
Of foui'nionlha Ihe e\peiiniec nuiiird wliile (akio^^ the lust tesL appeals 
to iosull in a median j^aui of four or five (jomis in llin second IQ 
No BiRniiieunl difference in iiinount of (»uin inado liy brii'ht, average 
or dull childien was fourul The prncUce effoct caincd beyond six 
months appeurs to bo mbif'niUeant. 

2. A deliiuto Lendoncy wa.B found for the pupils of high intelligence 
to gain nnd for of low inlelligenct* lo h>^e in Hi tvs they become 
older, 



SOME RELATIONSHIPS BETWEEN ALGEBRA AND 

GEOMETRY 

D0URI8 MAY LEE 
Ciloiidiilo City fJchools, Glendale, Cniif 

AND 

J MUmiAY LEE 
IDirector of Ilescarch, Burbank, Calif 

1. What 18 the relationship between ability in algebra and geome¬ 
try? 

2. What 18 the iclniionship between achievement in algebra and 
geometry? 

3. What perconUigpg of pupils show differences between algebra 
and geometry, in roapocL to ability and aclnevcment? 

4. Are the students wlio continue with geometry a more soleot 
group than all the pupils who took algebra? 

5. Do students tend to get bctlci oi poorer giades in geometry 
than m algebra? 

An attempt will be made to answer the above questions using 
data made available from two picvlous studies Since these studios 
were conducted a year apart, and two of the schools were used in both 
studies, thoio were complete rccoids in both algobia and geometry 
of one bundled cighty-ono pupils These rccorda consist of scoies 
on the Lee Teat of Algebraic Ability^ and the Leo Tost of Geometiio 
Aptitude® given before tlio pupils had begun the study of the respective 
subjects, scores on an nlgebiaic achievement test® and on the Renfrew 
Geometry Teat'* given at the end of the fiist semester of each subject, 
and the fust semostcr's maik in both algebra and geomotiy 

There has not boon an attempt to follow-up each case that took 
algebra. There was loss through failuies, drop-outs, and moving 
Whether the pupils that moved would be selected fiom the upper oi 
lower ranges of ability is not known, but the wnlcrs have assumed that 
the facloi of moving has not caused a distortion of the data 

by Publio Sciicml PuhliHliint; CJo, Bloonmigton, III , 1930 

’Publinlu'd l)y Houtlv(Mii Ciihfniiiiu Sohool Book Dopositoiy, Los Angoloa, Cahf , 
1031 

’A iioii-Hlaiid(\u!i/ 0 (l tcMt of (10 iLohih 

n\il>li8h('(l by (J A Giegoiy Co, Cincinnati, Oluo 
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What iii (hv u'laluniUnf} hdtipvn Mily ui alyibra and in pcomeiry? 
There is one publislu'd Hlmly, A 1/ UeRers/ jlmi furinalics data tluit 
is comparable with tiie data in iIm* pieaeut study J)r lloRcra found 
the correlation betwenn nlK<‘braic and KOOiiiHrm ability to bo ,52 for 
one Hcliool mid foi aiudlirr wilh an av<*raj;c eorielution of 47 ± .03 
When tluH uverapie was runentiMl for nllent iiuhon it Ijccanic ..54 ± ,02 
C/Orri‘la(U)im foural )k'Iw»*oii Mio las' Teni of Alftobnuc Ability 
and llieLco Tost of (loonichie Apfiliide for the one liiindiod oighty-one 
pupilb whoso couiploto roeorda weie uvmlublo '1‘hoHi; correlations 
with the corroclioiis for attenualinii arc given in Table I. 


TAitiin I — Tin; C'(mui:i.\jn»*r iimwm.n Aiiiiit\ in Ai.i.khua and Ability in 
CiTOMF/rnv AS .Shown ii\ uii. OniiitM.MioN «i,-i\vki,n 'laa Lkb Teat op 
AL ni:iiiiAi(! Aiiii.ni and thk Lik Ttsr oy Uv.oMm'mc At’titudh 



! KTAAKTCIA) 

r(TA A)(T.GA) 
corrected* 

School A 

■ 5.5 1 «l 

1 (10 -t ,04^ 


School fi j 57 » 07 j 02 I 07 

1 Kollcy, Tniiiiftn b . 'SStalislinil Method ” New York Miinnillan Co, 1023, 
p. 201, Foniiula lOOn 

* /t>vd ' P ‘209, V'mnmhi UVl 

li’roin the residlH of those two slmlics tin* concluHion cun be drawn 
that the correlation boiwccu iiWlHy to do ulgebui and ability to do 
geometry probably lies between 50 niul .0.5 

What ih llic idaiioiiHkip liUwcciL achici'cmcul in alficlna and achieve- 
menl in geomeUy? Alo.st of the Ktudies in Ihie field Imve dealt witli 
school marks The coirplaiion botwoen the final mark in algebra and 
the final mark in geometry has been found These stiidics aresum- 
marized in Table II 

In the present study lliero are two measures of achievement, the 
marks for the first scinostci of ulgcbiii imd gcomotiy and tlie scores 
on acbievemcnl tests given til llie end of tlic iiisL scmestei of the 
respective subjects These coirelalioiiH me jirehenlcd iii Table III. 

It, IS mlciesling in nolo that in neither hcbool m the con elation 
as higli between achioveuient 1 (‘hIh as it is b(*lween imii ks, This muld 

1 Rogors, A L,! Exporimniilal T<‘hIh of MiiUiem (itioal Ability and Their 
PrognoBlic Vnliic, Teachcis Collegf (‘ojilnhulion-t la JCilnrnlton, No 80 Now 
York Tcftchcra GeUege, CcUunlwft Ihnvi'Thily, IfttH, pp 7U-W1 
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seem to indicate an additional facloi, separale from achievement, that is 
influencing the marks 

From a study of Tables II and III, the corielation between achieve¬ 
ment in algebra and geometry probably lies between 40 and 70. 


TaIILB II.—CoUHKIATIONH nWWBKN AciIinvUMRNl? IN ALQBnilA AND Aciiibve- 
MHNT IN Gi:0Miyi'j{\, AH Mdabuuud by Tbachtjub’ Matikh, from Previous 

Ktudies 


Authoi 

1 

No of CRBCB 

Oorrolntions 

Burris^ 

IG schools 

67 

Crathorno* 

1900 (approx) 

62 ± 02 

Wmegardnor’ 

417 

600 ± 024 


> Burrifl, W P . Corrclationa of tho Abilities Involved in Secondary School 
Work, Edited by E 1/ Tliorndiko Columbia Umversily Conlnbulions lo Edn- 
talwn, Vol. XI. No 2, 1003 

*Crathornp, A. 11 "Tlio Theory of Conclation Applied to Scliool Grades," 
The IleorganivaLioii of Mnthomutica m Secondary Ediicntion, Chap X The 
Mathematical AHSoeiution of Amonen, 1923 

3 Wincgardner, J If Tho Rplation of Success m Mathematics to Success m 
Physics and Choimstry in High School Unpublished lifusler's thesis, Department 
of Education, Stanford University, 1029 

This fact and Talilc I lends lo show that the conclation between 
ability in algebra and geometry is usually higlier than that of achieve¬ 
ment, and further, that the coiiclalions between ability are more 
consistent than those between achievement 


TaRUI III— CoiUini.ATIONtt llfcTWBKN AciIIKVnMBNT IN AlOEURA AND ACUIBVE- 
MRNTIN GEOMllTin, AH MllAHURlil) BY TKACnURS’ MaRKS AND ACHIEVEMENT 

Tebth 



N 

r between marks 

r between tests 

School A 


474 i 044 

410 ± 048 

School B 

m 

709 ± 050 

6G6 i 069 


What percentages of pujnls show diflerences between algebra and 
geometry, in icspccl to abtlily and achievement? An attempt to answer 
this question is anoLliei means of attacking the pioblem of the relation¬ 
ship between thi'He two Hubjocts The method of finding such differ¬ 
ences ns called for by Uie question has lioen determined by Kelley ^ 

‘ Kclloy, Trillium L • A Now Mclliod foi Dcteniiinmg the Significance of 
DifforGiices in IiitPlligcrici* and Achievement Scoies Journal of Educational 
Psychology, Vol XIV, September, 1923 
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Tho mctliocl used ih lo find tliii valuo of then by referring to 

Table IV in Kelley's article, chnnf^c (his rntio lo a percentage. This 
then gives the, percentago of pupila that show differoncefi between 
algebra and geometry that are more frequent Ilian the chance factors 
m the measures would profluco. 

The data and formulae which are needed in this evaluation arc as 
follows: 

o'j-L. ^ “ t|( " ra„ (see Kelley*) 

and 

ffti — ■\/2 — 2ria 


TAnnn IV.—REiiiAniuTi Cokh'icients of ihb Vaiuouh Tkrth Wuicii Webb 

lFnp,i> 


UBLIAniWTT 

TrftTfl ('OtmcieHTB 

Teat of Algobrnifl Aliility 03 

Teat of Cicomotric AntUmie 01 

Algebra AcbiovemcaVlVsl .05 

Gcoinclry AoluovoinentTcHt 85 


The other correlation cooflicionts ncc(le<l arc found in Tables I and Ill. 

Tlic percentage of difforoiiccs in individual test scoron, as shown 
by the application of the above fonnuho and Talilo IV (Kelley*) 
between algebra and geometry in respect lo acluevoinont is forty-one 
per cent for School A and thirty-four per cent for Scliool B and m 
respect to ability is forty per cent for Sclionl A anil thirty-nmo per 
cent for School D. This indicalcs that tlicrc is about as laigc a 
percentage of dihoroiicGS found between nohicvcinont and also ability 
tests in algebia and geometry as there is between such tests m the 
Stanford Achievement Ballciy, as AriUimotio Clomputation and Para¬ 
graph Meaning.* 

Using the same technique, differences between the marks in algebra 
and in geometry wore determined. Using .70 us a reliability coefTicicnt 
for marks and the coriclations between marks as given in Table III, 
the differences wore found lo bo thirteen per cent and y.Rio per cent. If 
higher icliabilitics of inaiks hud been nasumocl theso difTorcnces would 
have been laigor, if howover, a lower coefiicient liad been used the 
differences would Imvo been oven less, 'riiose diffeiences seem to 
further indicate tlioro is another factor entering into llio marks m 


i Ibid. 
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both algebra and geometry than those that can be accounted for by 
achievement or ability. 

Are the students xuho take geometry a more select group than those 
who take algehraf In nnswoimR this question three sets of data will 
bo Boriitinizcd. These arc the algebra marks, algebra achioveinent 
scores, and the bcoioh on the Lee Test of Algebraic Ability. The 
records of those pupils for whom both algebra and geometry scores arc 
available will bo compared with tlio algebra record.5 of all the pupils. 

Fuat, llio algebia marks of the pupils continuing with geomoiiy 
are compaied to the algebra marks given to the whole group These 
facts are given in Table V. 


Table V,—A Compaiubon or the Mahrs IIeceivud in Fihst Semester ALaBniu 
BY Those Pupils Continuing in Geometiiy, with Those Teobivbd by All 

Pupils 


1 

Algebra marks 

Numbor rccpiviiig each mark 

PerconlaBo of 
pupils continuing 

AJJ 

Contmuiiig 

A 

34 

27 

79 4 

n 

126 

86 

68 0 

c 

162 

05 

42 8 

D 

12 

3 

26 0 

F 

73 

1 

1 4 

Total 1 

394 

181 

46 9 


In studying Table V, the fact that pupils may have moved, or 
postponed taking algebra should be consicloiod The last column 
shows that 79 4 per cent of the pupils who received in algebra 

continued with geometry Fiom this it drops to 68 0 per cent of the 
“B”a continuing For the ‘‘C”a it drops to 42 8 pei cent then to 
26 per cent of the “il’'s and to 1.4 per cent of the ‘'F”a or failuies 
It 19 obvious that a much gicator percentage of the pupils icceivmg 
“A’'s and “iJ”B coiiLinue Ihan do those icceivmg “C"’s and '‘D'’s 
Most atudenls looiMving “1)”h and '‘F"a m algebra consider that 
they have luul all tlie oxpoiionco with mathematics couises that 
they intend to liavo and thoroforc do not take geometry 

This condition would Ri*cm to indicate that thoi e is a need for careful 
guidance of tlic pupils ivJio nrc to lake algebra and the piovision of 
some oLhci course in mathematics for those pupils who will probably 
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fail or receive “I)"h, 'Hm couikc fllujuld Im much easier and cover a 
much broader inalheuiulieul liohl Hum Ihe legiilur algebra course 
Heoaiul, till! uoliievemfliit .scim-M of all jnii)ils are compared with 
those of the pupilH who eoiUimic with Rcoinclry I'hc records of the 
two firoupH uro f'ivi'ii in Table VI 

Table VI —A Oomps-iiihon («■ hil Hcoio s Hi rLivKi> ns an Aia.i huaio Aciiieyl 
MENT' iVsT AT IIIL KMI Ol- 1 UK 1* MIST M Hi, 11^ All. TUB PUPILB 

WITH Thohl nt THh Pnj'ii.s \Viui (JnsriM.jn wirii IIkowethy 
At t. I’l I'll ‘ < ustiNunui I’lipiis 



- tlfi 11 


21) 

22 

ffl 

U 20 

<Tt 

7 

fiS 


^ 10 

‘'M, 

- 

m 

A’ 

« 'm 

N 

181 



It can be seen from a» nisiieclion of Table YI lliat the mean scoic 
of the conlinuiiiK f^roup is ii SK points hiKlicr Ihini the moan made by 
all the pupils l)(iL‘H this indicate lhal llieie is a leal diffoi once between 
these two groups or is it ineiely a diffiueiiee lhal niiKht be caused by 
chance? Tins qnc.slioii can la* aiiHwerod by IukIhik the ratio of the 
observed diffcienep to the Ktuiuhvrd deviation of that difference 

If this ratio w over thus*, it is fairly ceiluin that there is 

an actual diffcronee, not a chunen difteienei* 'rho, fmmula used to 
find the sigma, of the (lifforenccH of the meniiM is: 

«r,or ^ Voi, “h (T,,/ — 2j{7,f,<rAri 



wliorc ffMi IS the a of tiio mean of all pupils (see Table VI) 
and ffu, 18 the a of the mean of the continuing pupils. 

In evaluating the above foritnila if r is given a value of the 


value will be a maximuni and 


Afa - Ml 

- - 18 a mmiinuin 


Evaluating 


hence 


(Trfif = .711 and Mz ~~ Mi = II 88, 


Mti - Ml 


- ri.M) 


Since the ratio of the obaorved difforemie to tin* Htaiidaid deviation 
of that difference la rnSfi, it is cciUiin that the diffeionce is real na far 
as achievement in algebra 13 concerned ami lhal the puinla continuing 
with geometry were eupenor in nchicvcnicnt to the group as a whole 
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Third, the scores of all the pupils on the Lee Test of Algebraic 
Ability are compared with those of the pupils continuing with gcom- 
etry The same method of comparison is used for the ability scores 
as IS used for the aohiovnmeul seoios. The jccoids of tiic two groups 
on the ability test aio given in Tulile VH. 


TAHLH VII.— a COMl’AllIHON OF Till] ScORBS UcCIUVUD ON TUB LbH TeBT OF 
AliQl.BHAIO AbIIjITI lIY TlIOHK PuWLS CONTINUING IN GbOWETHY WITH 

Tiiosn or Am. Pupils 


Ali. I’ljpii.n 
Ml = 81 03 
0-1 = 2‘i ()3 

o’ifi — 1 2*1 

N = 391 


CONTINUINa Pdpils 

Mt « 92 9‘1 

ffa = 21 81 

fAf* = 1 62 

N = 181 


It can be aeon from 'J'ablc VH, that the mean acoro of the group that 
continued with geometry is 11 32 points higher than the mean of all 
the pupils. ICvftUiating this difference— 

Assuming ? = 0, then = 2 04, and —^= 6.55. 

Cdif 

Since this ratio is equal to 5 55 it is certain that the difference was 
real aa fai na ability to do algebra, ns mcnsuicd by the Lee Test of 
Algebraic Ability is concerned and that pupils continuing with geom¬ 
etry woie Bupoi’ioi in algebraic ability to the group a.s a whole. 

The liireo sots of data, inailcs and nchievonionfc recoid in first 
Bomeatcr algebra and the scores on the ability Lest all tend to prove 
that the group Ibiit eoiitiimnd with geometry woie a select group as 
compared with the total gioup that took algebra. The poorer stu¬ 
dents, academically siioakiiig, do not continue with their mathematics. 
If by caicful educational guidance we would placo the pupil where he 
belonged in the first place, instead of lotting him find it by trial and 
erior, what a largo amount of Uiiic, money, and discouiagement could 
be saved 

Do studenta tend to net bctlo) or pooie) giades in geometry than in 
algebra? One moans of iinswciing this question is from an inspection 
of tho scattei'grams between marks in algcbia and in gcomotiy 

Chart 1 shown that impils tended to get poorer grades in geometry 
more often than they got. better oiioh as compaicd with their grade in 
algebra. 

It is intoi'osting to note that only one pupil raiseil his mark as much 
OB two points This pupil in IdoIiooI A received a C in algebra and an 
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A in geoTiictiy. Hie ubilif.y Ichl in alKobrw nliowcd ho was quite low 
but in Rooinotry his nliilily ftcoio wont up lo llio 75lh percentile of the 
group Ills achiovonionf, IohIh ugrood with (he marks, in fact, all 
rccorclK inchcalod lliat lie was rinly low averngn m algolira and superior 
in geoinetiy. He is tlic. host oxtunplo of inurkecl dilTcroncps favoring 
geometry tlial is in tlie sUdy. 


CUAUT I—A CnMl'AHlSnS lIKnVKKN MaIIKH llWhlVhO IN (jlDMKTUY WITU 
Tinwi/UhCBivBiJ IN Ai.cianitA 
Keliool A .School 11 

(tpomclry (icomotry 



The figures m bold face typo indicalo (he jiiipils IliaL loccived the 
same mark in bolli subjcolH Those above this dmgunul line received a 
lower mark while those below il icceivod a Inghm' mark. In School 
A, fifty pupils leceivcd the siime, mark, Iwenl.y-six impiovcd Lheir 
mark while »ix(-y lowered it. This siUmUoii is to lie expected since 
in the ease of algebra these pupils wcie a Hidoel group in the upper 
ranges, but in geometry these same caiirs wou* ri'dislnbuted over a 
normal distribution. It would liien be oxpeelod that tlio chances 
for a pupil to got a lower mark in goomotiy aii' greater than his 
chnncoB to got a higher maik In School A, tins chance of getting a 
lower mark was a little ovci two to one, while in School B it was nearly 
ton to one 

Another compariBon between nlgehra aiirl geoiiKdry (luit i« worth 
noting is the differences in the percenlugo of oiudi mark given. Taking 
the two school flyslemfl Unit wore Uhod in Ixilh studuiH, poicentugosof 
each mark given arc compnied in Talile VII], 

There is a slightly grentoi per cent of ‘'A”h givmi in geometry, 
however the outstanding dilTcronce ir m the iicrconlago of “D”8 
This might bo accounted for by the fact that algebia is much moio 
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definite and the failing point can be determined with more ease than 
in the case of geomotiy. 


TAULH VIII — A COMPAUIRON OP THE NVMDBR AND PeIICENTAQIH OP EaCII MaBK 
CiiVDN IN Alghiira and Geometry 


Mark 

Algebra 

Goomotry 

Number 

i 

[ 

Per cent 

Number 

Per cent 

A 



38 

12 2 

B 


BSH 

08 

31.4 

Q 



00 

28 g 

D ! 

12 

HUH 

61 

10 3 

F 

71 1 


36 

11,2 

Total 

304 


312 

100 0 


Summary 


Comparisons made between algebra and geometry using marks, 
achievement test Hcoies, and ability tost scores have led to the following 
conclusions. 

1. The relation between ability to do algebra and ability to do 
goornoliy as expressed by coirclation coefficients, probably lies 
between .50 and 05 

2 The conelation between achievement in algebra and geometry 
probably lies between 40 and .70 

3. The correlations between ability in algebra and geometry are 
usually higher and moio consistent than those of achievement. 

4. About 40 pei' cent of the pupils show differences between algebra 
and geometry in respect to both ability and achievement that can not 
be attributed to chance 

5 Some factor other than ability and achievement is entering 
into school marks in those two subjects 

6 Students who take gcomcliy arc a select part of the group that 
took algebra the year befoie 

7. Pupils loeeivmg low inaiks in algcbia do not ns a rule take 
geometry 

8 Pupils have a greater chance in geometry of getting a mark 
lower, rather than highci, than they got in algebra. 

9. It seems that it is moi*c diflicuU to dcteimine the failing point 
for a pupil in geometry than it is in algcbia. 
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The ediicnlsonul iinpIiciUKmH of Hio fnidiriKH hcom to bci 

1. Bolter KUidance of a pupil in Rfoitietjy m poKSiblo by using tests 
of ability to do groiiicliy (Imii by iiMiifj Ibo tdgobra record. The two 
however Hhould be iiHod loKOthiT, 

2. More careful educatioiml ^uidiiiice nlinuld be given pupils -who 
arc ready lo enroll in algebrii, luiii llie proliabh' failiireHeliminated. A. 
course should be provided for IIicm* pupils wlniih is nuioh easier ami 
covers as liroad a malliemutieal lield ua pos.'^ible 

3. Mni'ka should be given on the Viiihih of iichievemont. In order 
to oliinimite other fad ora winch me now deterniiiuijg Iho mark, such 
objeotive incasuics of achievement iia ar<‘ now obtainable should be 
used. The.se objeclivo (chIb should lie given seveial tnnoa throughout 
the somestt'i lo give u.s many jnetisuri's in' is p<».‘'siblt! 
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SCHOOL ACHIEVEMENT IN RELATION TO MENTAL 
AGE-A COMPARATIVE STUDY* 

ANDREW W BROWN AND CHRISTINE LIND 
lustitiiio lor Juvenile Research (Chicago, Ill.) 

I. Statement op Problem 

It IS fftirly well established that in the regular public sohool where 
the children arc of average intelligence, the achievement of those with 
intelligence quotients below one hundred is, in gonoial, above that 
which would be expoctocl of tlioir mental ago, while the achievement 
of the ohildien with intolligonce quotients above one hundred is likely 
to bo below their mental ago and the further the intelllgcnoo quotient 
IS below or above one hundred the greater the discrepancy between 
the mental age and achievement. In other words, the accomplish¬ 
ment ratio (All) which is the ratio between the educational age and 
the mental ago correlates negatively with the mtelligenco quotient. 
This is the case in the public school where the majority of the children 
are of average intelligence. 

But is it a general cliaractci'iatio of all dull children that their 
achievomcnt bo above thoir mental age and of all bright ones that 
their achievement be below their mental age, or is this only lelative 
to the group in which the children happen to bo placed? To be more 
specific. It is known that cliildien m the legular public school with 
intelligence quotients from seventy to ninety, have, in general, achieve¬ 
ment ratings above their mental age, but if these same children were 
in a group where they weio relatively blight, would their achievement 
ratings still bo above thoir mental age or would it fall below? Is the 
difforonoo between the mental ago and achievement ago the same 
for each school subject or do some subjects show a greater 
vaiiation than others? And again, at what level of intelligence is 


* Studios fiom thcj Institute for Juvonilo Ilosenrch, Oliiongo, Series C, 16B. 
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the variation the Kreatoet? Il ia Uicae prolilcins that this study 
attempts to invosligaU*. 

II. MKriion OF SToin 

Two groups of children wiTo wlecli'd for study, one group from the 
academic deparlnicnt of (lie Lmrolii State School for the fccblc- 
inniflcd and one from llie (tienwood Miinunl Training Scliool. 

At Taneoln only ehiWmi are udinitled to the iicadcmio 

(lopartinenl who have inU'lligeiiee (lUodenlH above 50. Thcic were 
four Imiulred children in tlie ncndeiiiic deparlmi'nl but only those 
above grade two wore Ufcrcd for Ihia study. Shoi tly after the children 
are committed to tlie mHtitulion, they are given the Stauford-Binet 
cxammation by the renideiit psyeliologisl. It jh the mental ago and 
intolhgenco quolienl Hucured by tins examination that is used hero. 
If the mental age Imd been w‘cuu'(l more tluni a inonlli jnior to the 
timo of the study, it wa« brought up to daU‘ i)y multiplying tho 
mtclligcncft quotient liy ihepn'smitchionologicul ago. 

Glenwood m a private school for depeiulent boys. 'I'liere ia no 
Belcclive factor oilier than depeiiUency in Iho selection of the students. 
Tho aveiage intelhgenee ruling of the entire school population is 
around .95. The, mental age uiul iiUelhgi'nee fiuolienl used in this 
study were secured from the Haggerty Intelligence iCxamination 
Delia 2. 

Tho children of botli groups woio given Uie following tests of tho 
Stanford-Acluovcmcnt Hcrica: 

1. Paragraph Heading. 

2 Word lloadiiig 

3. Anthmolio Reasoning. 

4. Arithmetic Computation. 

5. Spelling, 

In addition to tho above, Bamplca of wilting weie scoured fiom 
tho Lincoln Group and Bcorod according to llio 'J’hoinihke Writing 
Scale. One hundred twciity-fivo of Hub group weii‘ givi'ii tho Good- 
enough Drawing Test.* 


* Torman, L M,, (1. M. liacli, ami T. L. K(*Hoy *' Miiniml (»f Dircotiona for 
8laa(ou\»AcluovDinpnt 'I’csts.'^ %YorUl llouk ('omimny 

* Goodcnoiiftlij Florence: ‘'Monsuroini'jit of IntrlliKi'iicn hy Dniwiiiga ’’ World 
Book Company, 
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All of these tests except writing have been standardized for various 
age levels, and if there were a peifect relation (assuming the tests 
are equally well standardized) these age levels for the various abilities 
should presumably be the same Therefore, the amount of difference 
between the achievement ages and the mental age is a measure of the 
degice of lelationship 

III. pRESEWTATIOK OF DaTA 

(A) Retaided Group (Lincoln ).—Table I shows the difference for 
the Lincoln group between the mental age and the ages achieved on 
the other teats for the three levels of intelligence—fifty to fifty-nine IQ, 
sixty to sixty-nine IQ, seventy to seventy-nine IQ, for each of the 
different subjects* Reading paragraphs (RP), reading words (RW), 
arithmetic reasoning (AR), arithmetic computation (AC), spelling 
(Sp), writing (Wr), and drawing (Dr). The table shows that m 
reading paragraphs, the sixty-five children from fifty to fifty-nine IQ 
made a total of five hundred fifty-seven months above their mental 
age, and two hundred twenty-nine below their mental age. The 
average algebraic difference ((567-229) -i- 65)] of 6 04 months indicates 
a tendency for this gioup, in general, to make a rating higher than their 
mental age in this subject. The eighty-two childi en with IQ’s between 
sixty and aixty-nme make a total of five hundred eighty months 
above their mental age and four hundred ninety-seven months 
below their mental age On the average, they are l.Ol months above 
their mental age in reading paragraphs. The thirty-six children 
With IQ’s fiom seventy to seventy-nine make a total of ninety-four 
months above and three hundred thirty-two months below their 
mental age, with an average of 11.6 months below their mental age 
The differences between the mental age and the educational age for 
each of the other subjects are read in the same way The significant 
facts of this table are presented in Fig 1 

Figure 1 shows the variation from the mental age of the various 
abilities at the different levels of mtelligenoe. The mental age la the 
standard from which the variation is measured and is indicated by 
the zeio line. The difference in months between the mental ago 
and the ages m the different subjects is represented on the horizontal 
axis. For example. The children with IQ’s from fifty to fifty-nine 
aic, on the aveiage, 5 04 months higher in paiagraph loading (RP) 
than then mental age The childicn with IQ’s fiom sixty to sixty-nine 
aie 1.01 months higher, and tliose with IQ’a from seventy to seventy- 
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nine are, on the average, 6.61 months below their mental age in this 
subject. 

Tables II, III, and lY give the distribution of the differences in 
months between the mental ages and the achievement ages m each of 
the school subjects for each level of intelligence Most of the cases 
in the fifty to fifty-nine IQ gioup he within a range from positive 
forty months to negative foity months. Drawing shows the gieatest 
variation. 



fiB Rvy A« AC Wr Or 


Fi< 3. 1 —Lincoln Group showing the differences m months bohveen the mental 
ago ana the achievement ages 

In the sixty to sixty-nme IQ group most of the eases he within a 
range from positive thiity months to negative fifty months In this 
group also the achievement in drawing has the widest range extending 
from positive seventy-five months to negative sixty-five months 
These two groups have a range of about eighty months. The seventy 
to seventy-nine IQ group has a smaller range, most of the cases lying 
between positive twenty months and negative forty months, or a lange 
of sixty months. These tables show that the range of the cases for 
each subject m the three groups is about the same. In each of the 
gioups, drawing has the widest range. Since all of the langcs are 
about the same, the distribution of the cases seems to show that each 
group has about the same scatter and that the significant facts lie 
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in tliG cluingo of tlic average algebraic dilTen'iice rather Ilian in the 
range of dislribulion. Tlu* average algebraic dilTerfuccH linvo, been 
aliown in I’lg 1. 


Ta.i)LR II —Fifty TO FirxY-NihRlQLiwc’oi.N fSuoup Siinwisti tub I)i«TinnuTioN 

OPDlFFEUBilCBB IH MoSTHH UBTWbLH MkMTM. AuB- AS» lllKVRMBhT AliEH 
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Figure 1 shows that, in general, the lower the intelligence the 
higher the aohiovcment in relation to the menial age. The cluldrcn 
with IQ’s between fifty to fifty-nino arc doing warlc decidedly above 
their mental age level m all the subjects except Bpcllmg and drawing. 
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Those with IQ’s between sixty and sixty-nmc more nearly approach 
tlioir mental ago in all subjects except spelling and drawing, while 
those with IQ’s from seventy to seventy-nine have acliievomeni levels 
decidedly below their menial ago m all subjects. 

(B) Average Group (Glenwood) —The Glenwood Group was selected 
in order to clotcrinmc whether the londoncy for the brightest ictaided 
children to make achievement ratings below that which would be 
expected for their mental age, and the dullest ones to have achicve- 


Taulb III —Sixty to Sixty-ninb IQ Lincoln Gkoop Showing the Distiuuotion 
OP DiPPEiiBNCB IN Months between Mbntat, Age and Achievement Aqbb 
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mont raliriK8 iibovo their mental ukc*, i« typical of the rctaulcd childroii, 
or whether the aamo tnuleuey w prcficnt m children who mo not 
retarded. 

The Glonwood Rroup rcprosonlB a fairly avoniRc Rroup of boys 
The range of intclligeiiGO quoUenU was from nrty-fiv(i to ahouL one 
hundred forty. The average iiitelligonce quotient of Llio onlivo school 
population is about ninoty-five. 


Table IV- .S^:vK^^TY to SHVBNTr-.viNB IQ lawcoi.-i (Inaoi* HrKnvrwc} the 
D iSTiniiurioN ov in Months uktwbbn Mental Auk and 

AeillBVBMKNT AuEH 
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The group was divided into six IQ levels: seventy-nine and below, 
eighty to eighty-ninc, ninety to nmety-ninc, one bundled to one 
hundred nine, one hundred ten to one hundred nineteen, one hundred 
twenty and above The difloienco between the mental ages and tho 
achievement ages foi the vaiious subjects was computed and tabulated 
in tho same way as for tho Lincoln group. 

Table V prosonta tho same data for the Glenwood gioiip which 
Table I presents for tho Lincoln gioup. Tins table shows that tho 



twenty-seven children with IQ's of soventy-nme and below, made a 
total of one hunclicd thirty-eight months above their mental ago and 
eighty-one months below their montnl age in reading paragraphs 
Tho algebraic difference ({138 — 81) 27) of 2 11 months indicates a 

tendency for this level to make a latiiig higher than thoir mental agi* 
in this subject. Tho thiifcy-ono boys with IQ's from eighty to eighty- 
nmo made a total of two hundred fifty-mno months above their mental 
age and one hundred eleven months below then mental ago in reading 
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parof^raplm. Tlu* avcragi* algebraic dilTerencc for tins level wuh 4 77 
mouths above tlieir mental ngc. The forly-nnn I^ovk with IC^'h from 
ninety to ninoty-nliio Imd an average of 4 7‘A nionlliH lielow their 
mentnl ago m leading paragraplia. Tlie dilTen'Uces between tliG 
mental age and suliject ages for all the levels me r<‘ad the name way. 
Tlio Bignificanl fnclH of tluH table im* pieHeiUeii in I'lg 2, tluH figuro 
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presontB data for the Glonwood group Hiniilnr to tluil wliich l''ig. 1 
presents for tho Lincoln group. 

Figuro 2 shows tho variation fiom the menial ago of tin; various 
BubjeotB at tho dlfforonfc lovols of Iniclligonco Tho niontul age is tlio 
standard from which the variation is inenanrocl and is indicated by tho 
zero line. Tho difference in months between the mental ago and 
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tho ages m the different subjects is indicated on the vertical axis. 
The different subjects arc indicated on the horizontal axis 

Tables VI to XI show the distribution of differences in months 
between tho mental ages and tho achievement ages in each of tlio 
school subjects for each of the IQ levels. In this group most of the 
cases fall within a range of sixty months. As in the Lincoln group 


Tmii.u IX —One IIundhed to One IIundiied Nine IQ 
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tho range of tho cases for each subject is about the same. The signi- 
ficant facts accin to ho in the change of the aveiage algobinio diffor- 
cnces rather than in tho langc of diatiibutioii. 

Tables VI to IX (Glcnwood Gioup) show the distribution of diffcr- 
enccs m months between mental ago and achioveinciit ages foi the 
various IQ levels. 
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l^iguro 2 filiowe Uio samo tendency fnr tins Krouj) of l)oy« of average 
rnngti of intelligence, aa Fig. I nhows for llie retarded group. The 
brigliteat group liavo achievcmpnl leveln miinii below that wludi 
would bo expected of children of their n«‘iUid ag(*. Tlie dulleflt 
group, which included children of the pume h*vel of mLelhgence ivh tho 
brightest Ujvel in Die letarded group, make wcoren on (In* aeluevenK'nt 
teats inucli aliove their menlnl age. In geiieud, tli(‘ lo>',er the mtelli- 
gonco, Die higher Die aolnevemenliii relaluin to tin* meiHal age. 

IV. l)lH(ntHHION or llLHl'IiTS 

I'Tom a comparison of Kiga. 1 and 2 il i« evident that wlnle Die 
children with IQ’h from acvenly to hOvenLy-nine in the n*taided group 
are making aclvlovement scores fiorn siv to thirty monlliH lielow Iheir 
montal age in the different aubjectH, the chihUen of the wuiii! level of 
intelVigenco in Die aveuigo group aie making aehu'vernenl Heores from 
two to sixteen inonDis above their menial age. k'nim Ihis it would 
appear that tin; relation of acluevenienl to menial age ileiieinls not so 
much upon tin; level of mtelligence hut upon tlie [losition of that l(;vcl 
in the group receiving insti action. 

Ill studies of ohildron in tho public hpIiooIh, Pinlner and others' 
have found Dus samo tendency for the pchool uelin'vement of liiight 
children to bo at a lower level llmii their mental age, and for Dio 
achievement of dull children to ho ut a liigher level than Liieir mental 
ago. That is, the accomplishment lallo (lOA/MA) of liiigliL clnldren 
isj on tlio average, below l.UH and for dull children it is idiovo 1.1)0. 
Pintiicr* gives ns an explanation of tins that, “In general, children 
possessing superior intelhgoiice are Ilia onea who arc not working 
up to possible accoinplishmcnl, and the final v(‘rdict is that our 
educational system is failing to make use of the vast stoics of intelli¬ 
gence which lie hidden and undiscovered.” Wlnle it is not lim; that 
there arc "vast stores” of undiscovered inlelhgcneo in llu; letnrded 
group, it 18 true that tho relatively bright children of IhiH gioup aic 
not working up to possible accoinplishinent. 

Tho instruction of the teacher is u.sually adapted to the aliility of 
tho middlo group or to Dio ability of the largei numbi‘r If this is so, 

‘ I^intnor, U., and H. MtirstiuU: UpsiiIIr of Uio ('<aiihint<il-iiii‘atiit Kdiicatioiiiil 
Survey Tost Journal oj I'Jducattoml Ptiyehology, Vol, XII, No. 2, pp 82-01 
li'orgorson, T, L.. Tho Kflipiciioy Quotient as a Mfusnni of Aiilucvi'iiicnt. 
Journal oj Educational Jimarch, Yol, VI, No. pp 22-32. 

* Pmlner, 11. 'TntoUigouco Testing,” Chapter XT, p 2C3 
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the duller children have a greater amount of stimulation relative to 
their ability than the brighter ones, and the tendency would be for 
those at the extremes to approach the achioveincnt of the average child 
This may bo one reason why the brighter chilclien are below their 
mental age in achievement, while the duller ones are above. This, 


Tahlb X.—One IIundubd Ten to Onh IIundrbd Nineteen IQ 
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however, should not be so marked in a school whoie the classes aie 
small. 

Again, llio tcndoncy has been to keep childicn of tlic same chrono¬ 
logical ago together in spile of dilfeicnces in ability. The biiglit 
childien, tlieioroio, arc not icquird to woikup to tlieir possible capacity 
of acliicvcinont, noi aic they advanced tia far as they should be. The 
dull childien, on the other hand, aie uiged along in an effort to keep 
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them in their chronologlcnl nge group, ami, Ijecaupe of lluH iiisialent 
pressure, aro likely to ncc[Uire training above tlieir capacity. 

It 18 also true that the dull cinhlien of any given group have lind a 
longer period of training and expoiience than the bright clnldroii of the 
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same mental age m the same group. This training would tend to 
raise the achievement level of the duller cluldron and retard the 
aohiovement of tho bright ones in relation to their mental age. 

Tables X to XI (Glonwood Group) gliow the dinlribulion of 
difforoncos In months between moninl ago and aolucveinent ages for 
tho various IQ lovcls 















OBJECTIVE METHODS OF BANKING NURSERY 
SCHOOL CHILDREN ON CERTAIN ASPECTS 
OV MUSICAL CAPACITY 

THOMAS F VANCE 
Iowa SUito Collcgo 

AND 

MEDOEA B GRANDPEEY 
Ohio Stato Univcisity 

The elements in the situation which focused attention upon the 
possiblihty of evaluating the musical capacity of nursery school chil¬ 
dren by a method which might have some approach to reliability were 
three-fold: an enrollment of thirty-one children, a number of which 
wore almost invaiiably eager for and interested in the musical phase 
of the nursery sohool program; a teacher whose musical ability was 
considerably above the average, with a professional interest in a 
problem of this kind; and a psychologist on the staff also interested in 
the pioblem. 

Certain considerations had, of necessity, to be taken into account 
in outlining the project. Tho nursciy school at the Iowa State Col¬ 
lege exists primaiily as a laboratory for studonts in Home Economics. 
Whatever plan of investigation may be adopted must not mtcifero 
With the educational program either of the children themselves or of 
tho college studenls The teacher in this instance was employed to 
teach the children and not to use them as subjects for reaenreh. 

Out of these two limitations which tho situation inheiently forces, 
an important question arises to which the results of this study may 
give a partial answer; namely, the potential contiibution of tho nursory 
school teaching laboiatory to the aciencc of child psychology. 

The immatuiity of niusery school ehildicn is an ever present con¬ 
sideration in projecting a work of this chameter. In fact, wore itnot 
for tho child’s mental immaturity there would have been no point to 
tho project which is being reported The olnldrcn would have been 
rated on tlioir musical capacity aooording to the Seashore teats. Any 
method to have any value in determining a child’s mu.sical capaoity 
must bo exceedingly concictc, must hold his mtoiost and must be 
within his attention span. 

The methods to be described approximate these qualifications 
They wore concictc, they interested tho children and they wcic of 
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abort duration. I^ccorda \v<‘rc obtaiinMl on tho following cn|mcitic8 or 
abilities. 

1. IlosponHOB to music intrmUim! when the children were engaged 
ill other HpontaneouH niterests. 

2. llespoiiHes to the music playod during the regular iiumic period 
wlicn the children received wiiiu* fncouriigement to laki' pail in it. 

3. Imitating the nursery school leaelier in singing an intorviil. 

(In the instances just cited, the child was responding us a member 

of the group. In those that follow, Ihe child was alone with the 
toftchcr.) 

4. Ilcnling time to grapimphono mimic with tlie Itiangle, 

5. General responscH to mimic playi’d on tin; grapluiphonc. 

6. Imitating the nursery school leaclier m beating rhythmical 
paiterim on the triangle. 

7. Italings on the basis of Iho iimsicnl aspect of llic home environ¬ 
ment. 

The observations for responsiveness. Tests No.s 1 and 2, were made 
on a carefully prepared blank by a studenl-ossmlant who knew Iho 
children well. I'liey were made two or three clays a week for a peiiod 
of six weeks. A stenographic record wus taken for (ught dilTorcnt 
periods. The ratings were, based on responses shown (luough the 
entire period. A child could be sewed as high as live on each of three 
items, response while playing, presence in circle and response in Iho 
circle, with tlio possibility of a total scon* of iifteen. 

When the graphaphone music was used ns a stimulus the teacher 
simply said to the child, ^'I have some now ri'corils and I thought you 
would like to hear them.” Tho record was tlicn placcil on the 
machine and tho cliild oncouiagod to sliirl the machine. Tlie needle 
was placed in position by the teacher, 'j’he leacliei then said "Now, 
SCO what you can do to that muBic." Opportunity foi thice different 
responses to each selection was allowed before going to the next record 
but ill encli ease tho only encouragement from the teacher wus tho 
question: "What can you do lo that music?" For no respoiibc tlie 
score was 0; for verbal rosponso, 1; movcincnls of jmrts of llic body, 2, 
movement of tho wliolo body, 3; response appropriate lo typo of 
selection, 4. 

In tho phase of tho tost whore the child played the accomiiamment 
to tho graphaphone, a plus was rccordcil for each measure of four 
beats each of the march and skip rhythms and for eaoli measure of 
three beats each of the waltz rhythm played in time to tho music The 
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skip and march were each sixteen measurca in length and the waltz 
thirty-two mcnsuies The records were Victoi 20525-B, 20736-A, and 
36774-B. 

Beat results in the singing tests were obtained when it appeared to 
the children to be a part of the nursciy school program At the close 
of the rest perioil the name of each child was sung, one by one, with 
the instruction, "You may roll up your rug.'’ To illustrate, lot 
Jimmie bo the first child called. "Jimmie, you may roll up your lUg." 
(Jimmie's name was sung by the teacher) As Jimmie received his 
direction ho would put his rug away and join the teacher at the piano. 
Another child would then be called, Jimmie following the teacher in 
Binging the name of the second child and so on until nil had had their 
turn. Both ascending and descending intervals weio used. Credit 
was given for responses as follows: Sang one note but off pitch, 1; sang 
fln interval as clomon.strafeod but off pitch, 2; sang an interval of 
approximate pitch but not on pitch, 3; sang the interval, one noto on 
pitch, 4; sang the interval exactly, 5. 

Imitating the nursery school tcaohoi m boating rhythmio patterns 
on the tilanglc made the nearest approach to the conventional test 
situation of any in the senes. The patterns theinsolves, the arrange¬ 
ment, the metliod of preaentation and of scoiing which were finally 
used wore all evolved after a rather cxteucled Liyout with a three and 
one-half year old non-nuisory school child, a kindeigarton child, 
twenty-one kindergarten children, six kindergarten clnldicii and fifty- 
nine Icindcrgarton children, respectively. There was,however, so little 
change in the technique of the test after giving it to the fifty-nine 
kindergarten children that those rcaulls may bo compaiod with those 
obtained from the thirty-one nursery school childicn who wove given 
the tost last of all 

The triangle was selected from the other band and orchestral 
instruments used in the nursery school for seveial reason.s. It is one 
of the favorite instniincnts which was played daily in the nursery 
school by the children tliomselvca. It was given preference to the 
xylophone because of its constant pitch; to the cymbals, because it 
could be manipulated moie easily; and to the tambourine, because it 
offered fewer pos-sibilities for vancty in playing 

The method of presenting the prolfiom to tho ohildieii was as 
follows: Immediately befoie the child was biought in In be tested, the 
teacher checked Iier tempo with Liic beat of tlio mctiouome which was 
turned off before tho child came in. When tho child came in the 
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loacher began lulking about (lip Irmngle uml Hhowpd iho child liow to 
hold itr siiG would gnuip it at unr of (!«• an^tcH and aay, "This is tho 
way I hold it wlien I play ItTlionahc would hiuc the child practice 
taking it, helping him to ndjual hin fingcrH lo the proper pomtion. In 

TadU 3 I.—AniuN<jKUk.NT nr ilniTiiuo I’atikii'.h ah (Sivkn to TninTr-oNB 
Hciiom. tJiiiMoiBN with TotaI. HurnKw rna Kai it Pattbun 
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playing she was careful to look ut the liiiuiglc and to fiUiko it in 
approximately tho same place each time. Hhe tlicn Hiiiil, "I airi going 
to play some littlo Uinos on the triangle. Then you will play them 
and make them Bound just as I do. Liston.” Immediately following, 
the pattern wns played and the Irianglo and bar placed m the child’s 
hands. “Now, make it sound just as I did,” was repeated after tho 
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presentation of the first pattern and aa frequently afterward as seemed 
advisable to keep the attention of the child on the problem m hand. 

A response was scoicd aa successful when the child reproduced a 
pattern once, provided the playing showed a diffeionco of long and 
short notes in the order presented in the pattern, regardless of accent 
and volume. If played once in conformity to this standard, the scoie 
was counted as 1, if played twice, 2; if three times, 3, and if four times, 
4 The child was given ample time to play the pattern four times 
before the record was made on a picparcd blank. 

Thirty-six patterns were originally selected from a number of 
melodies found in a book of songs for young children. In the evolu¬ 
tion of the test they were icduced to thirteen as they appear m Table I. 
It appears from the total scores that n icairangemont is necessary if 
they are to bo given in the order of difficulty. 
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To get a rating on the home environment of the nursery school 
children as it pei tamed to music, the tenclier went into the homes of 
the thirty-one nuisery school children with a prepared form which she 
filled out by tlic method of diicot questioning. The form earned ques¬ 
tions relative to the piovision for musical impression and expression 
111 the homo and llio musical trniiiing and expeiionce in tlie homo and 
tlio musical training and exporioncc of the paicnta. Scores wore given 
on a basis of fiorn one to live ciodils on each of Llio following: inatru- 
mcnts in the lunne, singing, training of puionts in music and later 
cxpoi'icnco of paienls in music. 

Tlio limitations of this papci do not permit giving the results m 
full. The development of methods of dclcimining special aptitiulcs 
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of young childion is at present more important than results. The 
tables and graphs which accompany may be taken as samples 

Graph I, giving a comparative picture of eight children paired 
according to ages, is suggestive of the amount of individual differences 
in icaotiou to the various teat aituationa. Whether the assumption 
that one cliild lina greater musical capacity than anothci is truo can 
only be determined by a study of the child some ten or fifteen years 
latei. Then there will be the possibility of correlating the rcsuUa of 
the work in the nursery school with the results of the Seashore tests 
With this in view all oui niuseiy school school children are being put 
through this series, that sufficient data will bo available to make corre¬ 
lations significant. 

Graphs II and III seem to show that the two tests which they 
present are better adapted to the older children then to the youngei 
The smaller nuinlier in the singing test is due to the fact that the 
younger children could not be induced to sing They did do some¬ 
thing with the rhythm tc.st but eight of them not enough to get a score 
of more than zero The tests nio not iccommended for children 
younger than three years In tho rhythm test the median for the 
kindcrgaitcn children was 14 8, for the four to five year level, 8.84; the 
three to four year level, 4.18 and foi tho two to three yeai level, 2 43 
Further, tho correlation of rhythm with age m the kindergarten was .03 
while 111 the nursery school it went as high ns 37 To give any test of 
special aptitude too early may give merely a measure of maturity and 
not of tho aptitude m question. 

The highest coi relation to bo found m tho table is .02 between 
responsiveness and homo environment. It may suggest a possible 
carry over of musical oxpros.sion in the homo to expression in the 
nur&eiy school, making perhaps somo slight allowance for inheutanco 

One or two liy-piodueis scorn to have something more than pass¬ 
ing interest. In the singing test the average scores for the descending 
intervals are higher than those for the ascending intervals. The 
descending intervals were also lower in pilch. Tho question arises, 
“Would this diffeienco still obtain if pitch were licld constant and a 
much larger number of cases studied?” 

In the rhytlim lest the patterns m which the quarioi notes pio- 
ceded the lialf notes received higher scoies than those of tlie reverse 
order Tins (lifforoneo obtained in botli the kindoignrtcn and the 
nursery school groups. 
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Taken as a whole, the atudy may be used as an illustration of the 
use of tho nursery school as a teaching laboratory, as differentiated 
from a research laboratory, for securing data which may prove of 
soientifio as well ns of piactical value. Practical results certainly 
accrue m the stimulation of the interest of the nuisery school staff to 
securo as reliable information as possible about tho children. Only 
the future can determine tho scientific value of such a study. 
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U/iivrnuly of INilohur^li 


lNTl»)IM1«‘n0V 

The Problem. A rovi^'w of llio Jili*mlurr ri'VfHlH llial but fow 
of Iho many hUuIicb of nu’mory loucli upon ihi' fioin the point 

of viow of what is uclimlly miKMiilicrciJ of IIuiir^ i‘X|H‘ri('nc(‘<l in or(li« 
nary life aituationH. Tlin wrllorfl tiiul rrararch in ilnaKonoral field 
ahould Rivo profiUiblo rcUinm and Imvr umlrrlakcn nn invcsljgalionof 
n typical iiicmory Bituation, iiamrly, (hat of a reading of a 

Bhort infornmlive arllcln hy pupils in liie siToinlary hcIiooIh. The 
prcficnlHludy ih au aUciupi to drivnuim' thi* latige \m\ avevago, extent 
of immcdinle ami drlaycil faDluul inr-iiiory of pupils in (iradCH YH to 
XII for n short article which they reml a single lime and Ihe relation 
which oblainu betwoon memury at interviils of mereiisuig length. 

This and related problcniReinorKeiii uconHideration of the, practical 
eignificanco of tho classical labomlory fitndies of memory. It is 
uncertain, for example, whctlior we remember wliaL w<‘ obtain by 
reading and sUuly m the sumo way that w« roinembei material learned 
by rolo to the degree of oao errorleas ami unbe‘<lla(ing iccilal Tlic 
pedagogical Bignifienneo of exact informulion upon Ihia point relative 
to a single reading of an nrlicle la clear in view of the fuel I hat pupils 
in school and college commonly prepare assigimienls by ri'ading lessons 
a single time.* 

Related Studies .—A number of related invustiguliotiH have been 
reported during Iho past ten ycuis. Jones atudied th(‘ memory of 
collcgo studonls for the content of lectures in psychology The 


‘Acknowledgment is miido to Professor H U lUti'ii for fMiidiunontnl 
BUggCBtions. 

* Cf. Yoflkain, G. A.: "Itcading and Study '* Tho Mnotnillnn (Jo,, Now York, 
1028, pp. 18&-lt)0. 

* Jones, H. E : Exporimonlal Studies of Collcgo Tcnclmig. Arekives of Psy- 
ehology, No. 08 C1023). 
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students knew nn average of 62 per cent of the facts piesontcd when 
they were tested immediately after the lectures. After three or four 
days they remembered an average of 46 per cent, and after eight weeks 
memory dropped to 24 per cent. 

Several writers rcpoit conflicting results regarding memory over 
the summer vacation ^ llcccntly Bassett published a study of the 
retention of liistory in the sixth, seventh and eighth grades.^ Objec¬ 
tive tests weic given at the end of the course and again after intervals 
of four, eight, twelve and sixteen months Computing retention on 
the basis of the scoies in the initial tests, average memory scores of 
86.01, 81 51, 76 72 and 71 96 per cent respectively were obtained 
Since, however, no measures of validity and reliability are presented, 
and since the tests arc short and include four different types of ques¬ 
tions to whicli equal ciedit was given in the scores, the validity of the 
conclusions may bn questioned. At least the method hardly justiflos a 
statement such ns, “It is woithy of note that after sixteen months the 
children know seventy-two per cent of the history winch they know 
at the end of the scmcstci.''® 

In respect to method and results theie arc many points of similarity 
between Yoakam’s study of the effects of a single loading and tho 
present investigation. IIis finding that the effect of a single reading 
gives on the average less than half of the total ideas in the article^ is of 
especial interest heic. He also found that that the effect of a single 
reading vanes with the individual and from giado to grade; and he 


* Garfinklo, M A The Effpct of tho Summer Vacation on Ability in tlio 
rimdainonlnls of Arillinictic Jownal oj Educationnl Psi/choloQij, Vol X, 1010, 
pp 44-47, Kirby, T. J "Pincluo in the Cnso of School Cliildron ” Columbia 
TJnivorsity Conliibiitions to Education, No. 5S Bureau of Publications, Teachers 
College, Columbia University, Now Yoik, 1013, Nooimii, M E “Influence of tho 
Sumnioi Vacation on tlie Abililips of l‘'ifth and Sixth Guide Children “ Columbia 
University Conlnlnitionu to lOducnlion, No 204 IJuicau of Publicationa, 
Teachers College, Columbia UniveiBity, Npw York, 1020. 

* Bassett, 8 .1. “lletention of Ilwloiy in the Sixth, Sevciitli and Eighth 
Giadcs willi Special Ilefoicncc to the Enplorn that Infliienco llelention ’’ Tho 
Johns Hopkins Uiuviirsity Studieu in Pklueiition, No. 12 Johns Hopkins Pioss, 
BaUnnoro, 1928 

* Seo ibid , p. 01 

* Yoakam, G A.‘ Tho Effecla of a Single llendmg. Univerailif of loioa Sliidtcs 
in Educalion, Vol. II, No 7 The UnivcrBity of Iowa, Iowa City, 1024 Seo 
especially conclusions on pago 08ff. 
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queations wliclhcr a single reading without oiiy nnincdiato recall will 
leave any impreasioii on the mind of llio loarner after a lajiHc of twenty 
or thirty days, unless the mntonnl is very interesting or sinking. 


Matwuaij^ and Mbinoi) 

Children m Gradea VJI to XU aclcd aa Hiib/ects, a total 
of 2789 Inking part The cxperimoulnl group.s coiislbted of 2002 
pupils in tlio junior nnd sonior high acliools of Union town, Pa. JOach 
grade was divided into six numericfllly approxiitmtely equal gioups for 
piirpoBGB of rotation in the oxpcrinionla. The roniaining seven 
hundred twenty-seveu subject, drawn fioni noighlinring scliools, wore 
used in control oxponmouts: Control Group A, two hundn'd sovenly- 
eiglit children, for obtaining intrrcorrelntions lietween Iho tests; 
Control Group B, two bundled forly*fivc pupils, for an investigation 
of previous knowledgci of tUo articles; Control (.iroiq) (•, one. hundred 
cighly-two pupils, for obtnming a iiicusuro of how well pupils com¬ 
prehend the mnlenals. The median scores of these groujis in intel¬ 
ligence tests, reading and vocabulary tests correspond closely to 
published norms; licnco, It may bn safely assumed lliiit they aie fairly 
typical of the secondary school population.* 

The Readiny Sclcctwis — Tlwaa inlcreHling ami liiglily factual 
articles were used as leading Bclcclions, caoli printed in the form 
of a four-pngo pamphlet. “Itadium: The Magic Metal," containing 
1265 words, is an account of the discovery and uses of rmiiuin. "The 
Early Germans" describes the habits and customs of the early iiihaliit- 
ants of central Europe and is 1061 words in longtii. "Sir Kiclmrd 
Arkwright" is an account of tho life of the ICnglish inventor and con¬ 
tains 1279 words. These articles are well suilcd to the pmposo foi 
which they wore selected, since they abound in facta upon whicli 
questions can bo formulated nnd are of suitable difliciilty foi the 
grades studied.’ 


*Coniploto tnblos for all sconmariKnltonA contaiiied in tlrw piiper arc lo l*o 
found in A. G. DioUo, “rnotual Memory of Secondary Suliool I’iijiiIh for a Blmit 
Article Wliioh Tlioy Itoad a Single Time/' Doctor’s dissortiition, lalirary of tlio 
University of Pittsburgh, 1030. 

* For methods of detormining diflicuUy cj. ibid., pp. 51-50 
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The Teels —The testa wcic made up of five-response multiple 
choice typo questions and were printed in the form of four-page 
pamphlets. An effort was made to thoroughly canvass the articles 
for all thought units contained so as to make the mcmoiy tests as com¬ 
plete as possible. The test on llndium contains one hundicd items, 
the othei two one hundred twenty-five items each. 

In icspect to validity, objectivity and reliability those tesla com¬ 
pare favorably with tome of the bettor tests in standard ubo. Validity 
IS attained by thoroughly covering the content of the articles in the 
questions and is icndcred evident by an average mtorcoirolation, 
corrected for attenuation,, of .80 + .014 between the tests. Objec¬ 
tivity is attained by (a) careful instruction foi administration, (6) clear 
directions to pupils, (c) unambiguous questions, (d) uniform and well 
maikcd scoring keys in the form of stiip stencils, and (e) supervision of 
scoring by one lesponsiblc person. The icliabihly of the testa is shown 
by the following figuics, the reliability coeflicients being obtained by 
applying the Spoarman-lirown piophccy formula to the correlation 
between odd and even halves of the tests; 



Radium 

j CicTiimna 

Arkwright 

Reliability of Imlf test 

82 1 008 

SO i 005 

86 ± 008 

Reliability coofTicieiil 

00 4 OOf) 

04 ± 003 

02 ± 004 

Index of rchnbihty 

05 i 002 

1)7 ± 001 

00 1 002 

PE of estimate 

8 03 

.3 00 

3 72 

PE of incnsiircmoiit 

2 03 

2 50 

2 08 

Number of cases 

050 

007 

016 


Scaling —Since the tests aio designed to measure the amount 
letaincd, the best typo of scoic seems to be the peicentago of items 
anawoicd coneclly. In this way each item is considcied a unit, 
relative dilficulty of the separate questions being diarogaidcd. No 
attempt is made to coiiccfc for guessing, sinco instuictiona wore given 
not to guess. It may bo Htalcd that tins inothod of sconng lesulted in 
distiibutions approximating the normal about as well as can bo 
expected from the number used. Aikwiight gave an espeemUy good 
fit to the normal cuivo. 
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procedure.--'I'ho. inpthod of comludm^ Ihr cxponinpiilfi wjvs to 
give the pupils nil nrlicIPj with inBlriictiims lo rciul ft a fuiigle lime in 
order to answer a meniary lest at hoiup lune luler The jiupil wa8 
allowed to rend at I 110 own rale. Tlie lest given nriniedmicly 
after the reading in lOxiieriifient 1, and after intervah of I, I-l, :i() and 
100 days in Kxporinienta 2, H, 'I ainl r<*Mpeetna‘ly ]‘!acli group 
participated in the innnediato uininory expmnm'iit and in two delayed 
memory expcrimcid^i, iwing differont iimU*r«i)H for eaeli. The manner 
in which the groups and nmteriala woreiolaled iippearHiu the following 
scheme; 


Group 

Exponiiwiity pitTlicipRl<*<l in nail iiinlerad iiRcd in ouch 

I 

ICxp. 1, ItAdiuin 

Exp 2. Grranuin 

Ivxp 6, Arkwright 

11 

Kxi). 1, RAdmm 

Exp. It, (U'rntflnu 

ICxp 1, ArkwriJihl 

irr 1 

Exp. 1, Oornmn« 

Exp. 2, Arkright 

I'^fi ,*), Ihidaini 

IV ' 

Exp. 1, Gornmaa 

Exp. 3, ArkNynght 

Kxp, •!, Itnihum 

V 

Exp. 1, Arkwright 

ICxp 2 , lUulaaa 

Kxp /), (SormftJiB 

VI 

Exp. 1, Arkwright 

Kxp 3, tUi<iiuni 

Kxp. >1, (IrnimiiH 


The rending and tcsLmg periods were udniiniHlorml by the hhiglish 
teachers of the regular classes, thus providing a natural HchooUroom 
eilualion to the subjccls The teachers were carefully eoaclied in the 
manner of conducting the cxpcriincnts and iiiHlruoled to lepoit all 
irregularities to the experimenter. Ilefore the expcrinienis proper 
wore begun, all groups were given a practice exi'reiao consisting of a 
reading seleeUon and teat filmUar in naUire to Ihose above described. 
This served to acquaint the subjccls Ihorougldy with the details of 
taking the tests. 


Sui'I'LEMBNTAUY IIeSUI.TH 

Several fncLore which cannot bo eliminated l>y our mclhod inilucnco 
the results obtained. The appioxiinalo extent to wliieli two of tlicao 
enter was made the object of two control cxponmentH The points 
investigated arc (a) the mfluoncc of previoUB hnowlodgo and ability to 
answer questions by logical thinking and (6) the faduio of pupils to 
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answer questions because of comprehension cliiReuUies and oaicless 
work habits 

Previous Knowledge —Contiol Group B was required to answer 
the tests without previously having read the ai tides. They were, 
furthermore, instructed to guess when they did not know the answer 
to a question. The results aic somewhat confusing, since the medians 
are in inverse i elation to grade. The reason for this, however, 
becomes apparent upon examination of the papers The lower grades 
complied more fully with the directions regaiding guessing and, there¬ 
fore, had more opportunities of getting items coiicct by chance The 
actual medians range from 32 3 per cent in the seventh grade to 23.5 
in the twclftli for Eadium, fiom 30 8 in the seventh to 25.0 in the 
eleventh for Germans, and from 24.8 in the seventh to 18.6 in the 
twelfth for Arkwright. 

The instructions regarding guessing wcic given for the purpose 
of extracting the correctly guessed items from the scores by the 
commonly used formula foi correcting multiple choice teats;* however 
the correction could bo accomplished only in the seventh grade, since 
in this grade tlie directions wore strictly followed When the scores 
for the seventh grade aie subjected to the formula, the following 
results remain as the appioxiiimtc scoies that pupils in tins grade are 
able to malvC without previously loading the articles: lladium 16.4 
per cent; Germans 13.4 per cent; Arkwright 0.0 per cent These 
amounts aic interproted as due to previous knowledge and logical 
thinking and aie m harmony with the findings of Yoakain in a similar 
experiment.* 

Comprehension Di^icuUy and Carelessness —The ability of pupils 
to answer the tests when they are allowed to look up the answers in 
the articles may be taken as ii measure of how well they compiehend 
the materials and how caioful they aie in Ihcir work. Contiol Group 
C was used for determining this factor The means for the respective 
grade.s range fiom 82 0 per cent in the eleventh grade to 66 0 m the 
seventh for Geimans, and fiom 73.0 in the twelfth to 54 3 in the seventh 
for Arkwright. Tlio dilTeicnce between grades are for the most part 
relialilc. The average of all gmdc.s m Germans is 76 7, in Arkwright 
63 5. Tlius tins gnuki missed nliout twenty-five per cent of the 

‘ Correoted scoro = No, nght — 

^ (« - 1 ) 

*Ojj. «i,pp 68-50 
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queHlioiis on CicrnianH anti almu!. lliiriy-t^cNoti |H‘r coni of Ihosc on 
Arkwright Ixicaufic they tlnl nr>l coiuprchoiu! tlu; iiintorlah read or 
were loo carolcgs to do llmrouKhlv ftcourato work 

Although Ihc influence of ihi* nhovr farlorn have not been deter- 
mined with cxnctncHa, ncverlhelcHs the mntnd cxiMTiimmiK ahow that 
it is significant; and the ox|K‘riii)riilnl rcfullH iiuist, accordingly, bo 
interpreted by tlic reader with ihcM* fiicla iii nmnl. 


FAcruAi. MKU<mY aktkh Kivk Im'khvai.s 

Statistical Treatment. -Two iiicthodK of HUinmanr.mg the resulta 
arc employed. The first inakcs use of the coinnum atatisticnl device 
of describing group results in (criiiK of nieaiiK and standard deviations. 
This method brings out the trend of lh<‘ data in a Hlraightforward 
manner which needs no further coininont. 

The other inclliod is made necessary beeause (ho lecbniquo of 
equated parallel groujis was not followed. For tins rt'asoii the various 
sub-groups arc only roughly coinparahlc, the group i\v(*raKo depending 
to n largo extent upon the ahilily of the imrlicular group relative to 
entire grades or all groups taken logetlier. To obtain eomparablo 
rosuUa for grades or other aulr-groups, it is necessary (iml to IraiiBitmlo 
scores derived from the three diffenmt miitennlH into equivalent ternis 
and tlicn to coniliinc tho roaultfl into an nverage ri'presciitntlvo of the 
combined gioups. 

The best mclbod for accoinpliehing (bis ih (o make use of the 
regicssion equations derived from the correlalioim lietwcen the 
materials. It will be romcmboicd llml Control Croup A was uhcd for 
the purpose of getting correlations between llic three malcrmlH. Fiom 
these correlations the regression equation between itudium and 
Arkwright and between Gcnnaiis and Arkwuglil \>cre ih'rivcd, tho 
resulting equations making possible Urn conversion of reaullM in Hiulium 
and Germans into scores equivalent to Arkwright Hcorea and tlie com¬ 
bination of all three groups in terms of im average fur tlui latter 
material. To distmguisli UiiH ilorived seoro fioiu the Hrores of groups 
actually using Arkwright the term *'A-aeore'' will Im used. Tlio 
actual equations for deriving A-eenres from llio rCHulia in Radium 
and Gorman were found to be; 


A-score = .80 lladium -f 2.4 = .07 Germans + 11.0. 
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Similar scores may, of course, be derived in terms equivalent to 
Radium or Germans. The reader may get nn approximate value for 
R-scoros or G-acores by adding ten points to the A-gcore avoragos 
herein reported. 

Immediate Memory —Table I gives the means and standard devia¬ 
tions of the respective groups for the material whicli they load and 
the A-scoio avoingoa of the combined groups in immediate memory 



Fiu 1 —IHatORram for iminodiftto inomory of ArkwriglU compared with a normal curve 

aUod to tho dntn 


The total range of the distributiona arc fiom thirty-one to one hundred 
per cent for Radium, from sKLccn to one hundred pei cent for Germans, 
and from sixteen to ninety per cent for Arkwright. Thus pupils in tho 
junior and bomoi high school scoic over four-fifths of tho entire scoring 
range of these losts, which hIiowb that individual diffcioncos in this 
ability are groat. Tho disUibutums for lliidium and OoimauB aro 
somewhat negatively skewed, *S'fc being —.352 and — .2(56 rcspectivoly '■ 


3(Mcftn — Motliftn) 
‘SA,- -- 



B94 The Jdurml af KduralUmnl P^Uf'hdoQy 

Tine imlical(‘H that ihnro iskhtk* piliiiKUp of imnu'tliulo inoninry scores 
in tlic upper part of llie raiiKe for Ihen** nrhrlf’H, ArkwriKiU, liowovcr, 
givea u very gooil approxiiiuUioii !o Ibe (jauef-oui furv(‘, Sk. being only 
.032 niul IViirson'M clii-K(|U{irc ti'Si of of lit giving ii P value 

of .370, which iH very Huti^faolory for a poimiulioii of nlighlly more 
than 000.* The conipari'nm of llu* hUtor (hHlnluilion with the 
theoretical normal curve filled to the ihila ih !*)inssh Krajihically in 
Fig. 1. 


Taio-k I.- Avi.kamk PeiM’Kstaui. iMUJ.niATB Mr.Motir 



llarhiiiii 

CWrmniiH 


Arkwriglit 

A'Seorc 

Grade 

Menu 

.41) 

N 

Mean 

81) 

iV 

Minn! 

WI) 

jV 

Mean 


XII 

84 3 

7 (1 

m 

m 

12 A 

(i7 

Oi 

h] 

n 2 

100 

(1.5 2 

214 

XI 

77 U 

lU 1 

110 

BB 

12 2 

1(11 

(i2 

7 

n 2 : 

01 

02 3 

278 

X 

70 0 

11 0 

121 

Ess 

12 3 

122 

57 

•1 

M n; 

123 

50 0 

111 

IX 

72 4 

10 G 

130 

07 3 

13 0 

KHi 

r,n 

3 

12 i| 

12(1 

55 5 

374 

VIII 

iiO 0 


72 

57 13 r 

120 

50 

0 

14 l] 

131 

51 3 

323 

VII 

07 3 

12 0 

ns 

53 8 

15.(1 

m 

13 

il 

12 ii 

75 

50 0 


VII-XII 

73 4 

12.4 

■ 

(14 8 

15 7 

(157 

51 

(V 

11 i| 

025 

50 7 



Taulk U.--PBKrKKTAMB MK«4miV Am.n Os»: Uav 


Grade 

lladuiom 

Gcrnmim 

Arkwright, 

A'Hcoro 

Mean 

BD 

N 

Mcflii 

HI) 

N ! 

Mean 

HI) 

A 

Mem 

N 

Xlt 

72 0 

10 7 

74 

71 a 

0 0 

30 

03 3 

K 0 

3.5 

(11 1 

189 

XI 

04 0 

11 8 

20 

50 3 

14 0 

53 

55 2 

0 -1 

52 

53 2 

131 

X 

66 3 

10 7 

43 

58 a 

15 7 

00 

-10 7 

12 7 

57 

47 0 

IGO 

IX 

60 1 

13 0 

02 

54 2 

M a 

00 

42 4 

12 H 

31 

40 0 

ICO 

vm 

65 0 

12 3 

01 

55 1 

13 0 

34 

43 4 

10 3 

57 

45 3 

152 

VII 

47.7 

16 4 

33 

40 0 

10 3 

00 

3.1 5) 

H 3 

71 

40 0 

178 

VII-XII 

88 7 

15 1 

301 

50 7 

17 2 

312 

40 4 

15 0 

303 

48 0 

019 


Delayed ilfemory, One Dayr-^Tha average ii’sulH for memory after 
ono day aro given in Table, II. The dinlnhuhons iiu! Hiinilar in iialure 
ns in the previoua exporirnonl. The range in Iliulmm ih from 11 to or» 
por cent, in Germans from 10 to 95, and in Arkwright from (i to So. 


^Sco K J. Ilolaiiigor, "BtatiBlicnl McUioda for HlmlejitH <if ICducalion" 
Gum and Co., Boston, 1028, pp. 2ir)'-2d8. 
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Thus the same wide range of individual differences is to be noted as in 
immediate rnemoiy. 

Delayed Memory, Fomieen Days ,—^HesuUs for memory after four¬ 
teen days are shown in Table III. The distributions at this interval 
have become positively skewed, showing that the task ia becoming 
moio difficult. Sh is .191 for Radium, .405 foi Gormans and .405 for 
Arkwright. TIkj lango in Radium is fiom eleven to seventy per cent, 
that in Germans is flora six to cighty-fivc per cent, and that iii Ark¬ 
wright from one to sovouty per cent. Again ivc find ability in these 
giadcs to range fi om very low to very high. 


Table III —Peuccntaob Memoiiy Arrnn Fourteen Days 


Riulium 


GcnminB 


Arkwiiglit 


A-Sooro 


Grftdo 

Mean 

BD 

N jMcan 

SD 

N 

Mean 

SD 

N 

Mean 

N 

XII 

40 

1 

11 

8 

34 

61 

3 

13 

2 

27 

32 

0 

10 

0 

27 

30 

8 

88 

XI 

60 

0 

11 

4 

31 

mm 

7 

13 

8 

64 

32 

3 

12 

3 

42 


0 

127 

X 

40 

8 

10 

0 

74 

44 

2 

17 

0 

48 

34 

4 

12 

1 

65 


1 

178 

IX 

44 

0 

9 

7 

04 

38 

8 

11 


02 

32 


10 



35 


195 

VIII 

46 

2 

10 

0 

04 

34 

3 



27 

28 

8 

11 

3 

63 

33 

8 

147 

VII 

40 

7 

I) 

6 

35 

37 

ti 


E 

71 

37 

0 

16 

2 


30 

3 

106 

VII-XII 

43 

7 

11 

0 

302 

42 

E 

14 

1 


33 

1 

12 

E 


m 

3 



Table IV —Peucentacib Memory after Thirty Dayr 


Grade 

Radium 

Gormang 

Arkwnglifc 

A-Scoro 

Mean 

SD 

N 


SD 

N 

Moan 

SD 

V 

Mean 

N 

XII 

37 9 

9 8 

23 

H 


35 

31 3 

11 0 

30 

33 8 

88 

XI 

42 1 

12 0 

60 

mm 

ItMO 


31 6 

12 5 

48 


124 

X 

42 2 

11 1 

64 

32 1 

8 5 

34 

37 8 


47 

36 7 

136 

IX 

37 1 

11 6 


32 1 

KB 


25 4 

8 9 



186 

VIII 

37 7 

11 1 

68 

41 3 

11 4 



7 7 

20 

33 2 

145 

VII 

37 2 

11 1 


mm 


34 



68 


168 

VII-XII 

38 3 

11 0 

300 

m 

10 7 

243 



280 

32 4 

836 


Delayed Memoiy, Thirty Days .—Average icsulls for memoiy after 
tlurty days are shown m Table IV. The nature of the distributions 
(slccwncBs) 18 tlio same as in the proceeding expenment Scores m 
Radium range from six to eighty per cent, in Germans from six to 
seventy-five, and m Arkwright from one to seventy-five. 
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Delayed Afemory^ Om Hundred Dayn Tli/‘ r(‘hullH for the fifth 
cxpfnjnciit firc' wlu)^vn m V. TIu* Hn»r<*8 in Kndiuin range from 
ones to wvoiUy-livp por PHit, in CimiiwiiH from oiu* to mxly, and m 
Arkwnglil from ont‘ lo iiim-ty An m tJu- provimin cxponitiont, akew- 
i\cs8 in nlifthtly pomlwo, nlutwinK luawiun of ^r•o^i'n bclmv the moan. 

Tmm.k V - I’rm rsTAiiK Mkmiiht f»*.n ItOf.ruiKo Dayh 



lUkdiulii 


(•ei 111'lint 


Ark^^riidil 


A-Bcore 

(Irmlc 

] 

Meiut 

SI) i 

\ 

.V 

Mt'an' SI) 1 

A' 

Ml'in, 

M) : 

1 

.V |Mpati 

N 

XU 

:i!) l' 

1) kj 

n. 

33 ;t| 11 /! 

IVl 

22 il’ 

111 I)' 

26 

31 2 

121 

XI 

ari ij 

11 a, 

■17 ’ 

3.'i tv, 7 a 


J 23 n 

la i 

20 

20 0 

102 

X 

:io o' 

11 .si 

•I.'i 

31 'll H) 2 

43 

2s 7 

a 11, 

r>{) 

30 6 

147 

IX 

38.01 

8 2 

30 

2li f», h 

27 

' 21 0 

in .1 

33 

28 .5 

00 

VIU 

31,1)1 

H 3: 

67 

2U ll 7 .'i 

.n.*; 

' 22 <1 

ir. [ 

2'> 

27 9 

141 

VII 

27 3 

7.1 

OH 

i i 


; 20 6; 

7 (1 

1)3 

2r, 0 

131 

VIl-XU 

33 0 

0 h; 

t 

270 

32 li W n' 

2!S 

' 23 1 

12 2 

21.') 

30 0 

732 


CoMrAUISON or Ci«AI)Kh IN Fa^TI All Mkmohv 

eSrade Averages.’ TliC (lulu prrwiih'W iji tho pinvioiiH Tables 
(I-V) enable ub lo make (he* ranowin^ rnmnatiHoiiH of llio grades 
participating in Uicso cxpariinoiKH. 

In immodiate memory the avrragOH im'reaf .0 <piilo markedly from 
grade to grade. Of the Itfieon coinpamons tliut tony bo made on the 
basis of the roaulla of the various nialeriula (dglit «if (las chfTercnccs 
turn out lo bo four Umea Ihpir prol)abU' errora or moio and arc, 
therefore, completely relialilo, Three mote eomparmimH me difFcr- 
enccs 1.8 tiinos their probable errors, or better, tin* cImneeH of a line 
difference grcalci than zero being al letisl ninety in one luiiidied A 
comparison of the A-Seore means ie,veals an average increimo of II Oj 
per cent from giade to grade, all the (lifTerences lieing reliabh* 

In memory delayed one day the grade averages again inciea.se ns 
in Experiment 1. Of tho fiflcen conipailsonK hix give leliabln difTci- 
oncoB, and four more tuo more than 'i.fi limes their i>rol)id)le eiiois 
Tho A-Scorc differcnccH between (ho ni(*anH of the gi'iulen iwi'nige '1..) 
per cent, but all nro not completely reliable. 

In tho cxponinonta with intervalH of foiirLemi day.s and longei, 
no relationship is Lo bo noted between faclutd memory niul grade, llio 
rank older of the guides being haplm'/ard ami moKt of the diffeionces 
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being negligible. Wherona the means of the seventh and twelfth 
grades m the immediate memory and one day delayed memory 
experiments are well set apart by a distance of about 1 5 siandaid 
deviation of the entire distribution, the differences between the 
lowest and highest averages m the experiments with longer intervals 
are small It may be infeircd that groups originally quite diffeicnt 
with respect to knowledge of an article road a single time become more 
and moie alike with lapse of time— i.e., the factors influencing foi- 
geiting operate dilTerenUy on gioups of diffciing abilities. 



Fia. 2 ~Porcontilo ourvos flliowiiig tho ovorlapping o£ grfldoB in immedlnto niomory for 

Arkwright 


Overlapping of Grades —^While the average score in immediate 
and one day delayed recall increases poiccptibly with grade, nevci- 
theless adjacent grades overlap to a considerable exLent We find, 
e.g,, that tho seventh, eighth, ninth, tenth, eleventh and twelfth 
grades icach or exceed the mean in imincdialo inomoiy of lladium for 
all grades taken logother by the following ainounta respectively: 311 0 
per cent, 25.0 per cent, 40 3 per cent, 57 0 per cent, 58.0 per cent, and 
86.8 per cent. Again, 85 6 ppi cent of the distribution of Uio combined 
grades for Radium in immediate memory fall wiLliin a lango common 
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to all sixgmflos, and, Biniilnrly, H7,2 per cent of the coinbiiiod scorea 
in Germnns and 82,0 por coni of IIkxsc jii Arkwriglil Tlio degree of 
overlapping is strikingly brought out by I ho porcontilo graph for 
immediate memory of Arkwright, Fig 2, from winch iiiiiy be rend the 
percGiitftge of scores of tiny giiulu which fall below or above any given 
point in the distribution of any oilier grade The curvea have been 
smoothed frec-lmiul 

Correlahons.—The product luomcnt eorrelalioiiH obtained for 
the factual memory results of several of the groups with grade m school 
are presented m Table VL It will be seen that llui correlations 
between iininediate memory and grade are positive and low, those 
botween delayed memory and grade aie negligible. Those icsults are 
in accord with the foregoing analysis of grade averages, The alight 
correlations which do e,\i8fc, ns will he shown in a later arliole, are due 
to other factors rather than the accident of grade. 


TAniiB VI.— ConiiBLATjoNs OP Factual MiMoiir and GnADB in .Sowool 



Itadmm 

(if*rnmnfl 

Arkwright 

Aver- 

Vnrmhlca 









r j 

Fii: 

j r 

VE 1 

r 

' IM'l 

r 

Immeiliftto memory and griKle 


o;ij' 

1 

21 

oil 

29 

045 

34 

Fourteen day memory and grade 

tn 1 

(Hi)' 

I 

( 111 ) 

“ (17 

(113 

10 

Thirty day memory mid grade 

11 i 

.()i:i 

07 ! 

019 

3(1' 


18 


(To be concluded ta Dccctaljcr issue) 




WHY OTIS’ “IQ” CANNOT BK KQUIVALENT TO THE 
S'rANFOllD-BINET IQ 


PiSYCJlIIi OATTELti 
1 InrvArd Uiuvoi-sily 

Dr. C)ti8 lura dovirod a mcamin* of hrightiioHa for uso wiUi lua ficlf- 
administerinp; 'foafa whioli in dorivod by dctcrminiriK tbo mirnbor of 
points m Hcoro iho. cblld vanes from liis ngc norm, if he is above tho 
norm this amount is addtid to oiio liundied, if below sulitracted from 
one hundred. Dr. Oli.s .states that when an IQ has been found by other 
means than tho Binet Te.sts the Icim "IQ" must not. be used without 
qualification, yet ho \vi lies that "it heemed ])c.sl simply to call tins new 
measure of brightness an ‘IQ.’" He appnrcnlly justifies the use of 
the term "ICi" on llio erroneous belief that hm measuic of brightness is 
equivalent (o the Bind Ki and (hat the group lest Ki's obtained by the 
standard method aie no(. 

Dr. Tormnn found (lie middle fifty per cent of tho Slanford-Binct 
IQ's to linvo a range from iii«ely-lwo to one Inindred oiglifc Dr 
Otis founil the middle fifty per cent of tho aeores iiifule m his tests to 
have approximately llio same range in the aeveral age groups, that is 
that fifty per cent of (he cases f(‘ll Avithiii eight points of the norm, ho 
then concluded: 


Forlinialc'ly, Ihcroforo, {'a«*h pmiit ui Iho Hf ore of an individual above or below 
tho norm for bin aga lopu'seiila a poiiil in I(i ubova or below ono lumdiod If an 
individual BcorovxrvrdH (lie iiorin for hiHiigo by twolvo ])oin(a, lim IQ is ono iiundrod 
twclvo . TIiik being llu> (‘iik* il seiunnd bast sunply to call tins now mcasuro 
of brightncflfl an “Ki " 

Dr. Otis ha.s failed to lake, into account the fact that two distiibu- 
tions may luvve Llie, hume medians and (he same midcllo fifty per cent 
range and filill dififei widely iiL llio exticmca It can bo shown both 
theoretically and einpuicully lha(. Iheie is a constant diffeience between 
tlio Binet Ki and Otm' "l(i" at the evtiemeH, ('.specially the upper 
oxticine. Tlmli tins iuuhI of neeeasily he. Uuo can be (Dnumstialed 
from the data given in (ho manual of (hieclioiiH foi tho “OUh Helf- 
admlnmtenng Ti'sls of Menial Ability." An inspection of tiui table 
of norms to determine the iiigiicsl and lowest, "KJ’’ that it is possible 
for a child of agivcn ago (o obtain by tins method will show the iinposai- 
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bility of the range of Dr. Otia’ nieiitture lioing cciunl t(j tlmt of the 
Binct IQ. 

AVIiile Dr. Otm makes no mention of Urn relative relial)iUty of his 
table of norms at different agoa, it ia pcrluips, not fair to oxi)oot too 
great accuracy at Iho cxtroinea. Thorofoie, the ages of 10-0, iIl-0 and 
15-6 havQ been splecLcd for a com])ari«on of Ihc ibnet Ki and the "IQ” 
obtained by Dr. Otis' method. TheHoagffliuc the (luai tile points of tho 
ago rnngo of the table of norms and fliiould ineludo Iho moio roliablo 
part. The curve to tho left of the accompanying clmrt ia llio frequency 
distribution of the IQ’s of Professor Tcrnmn'H original one ihousand 
unsolecfced Stanfoid-Ilincb IQ's. The curve to the rigliL la a fiequciioy 
diatribuilon of the Binct IQ's of his siv hundred forly-Uipco gifted 
children, largely from Grades III to VIII and all below tho ago of 
fourteen years The lowest and highest Olm "IQ's" tliat it is 
possible for children of a given ago to obtain on the Intormedialo 
Self-admioistoiing Test aic iiuUcatcd on the TQ scale ul tho foot of 
the cliart. 

The highest possible Otis “IQ" that could be obtained liy a child 
aged 13-0 on this teat is one hundicd tliirty-one and the lowest fifty-six. 
This is a narrower rango than that of the Stunford-Binct IQ's. If 
Professor Tcrmnn had used this test and inelliod in selecting his gifted 
group he might liavo found one or two clnldrcn tliat mcusuiod up to 
ono hundred thirty but none above one hundred Ihirty-ono (hia group 
of SIX hundred forty-tlircc conlmncd only ono case with an IQ below 
one hundred thirty-five). At tho ago of 10-0 tho highest possible Otis 
"IQ” is ono hundred forty-eight (approxiinaloly one half of Professor 
Terman’s gifted group had IQ's of one hundred fifty or higher). Tho 
lowest a child could attain at this age is hcvcnty-thrco ICveiy large 
school system has a number of children with Binel IQ's below sovciUy, 
At age 16-Q tho highest "IQ” obtainable is only ono huncliod twenty 
approximately two standard deviations above tho norm. Kven if the 
advanced test were substituted for the intermediate the Inghcst possible 
"IQ” would still bo only ono hundred thirty-Bevon. The lowest 
“IQ” obtainable at this age is forty-live, even this is not as low as 
tho Standford-Bineb IQ’s fiequontly met witli. At no ago is there a 
possible Otis "IQ” range of more tlinu aeveniy-fivo points. At 
the age of 12-0 it is thooreiionlly possible to got a range from 
slxty-thieo to one hundred thirty-eight, A younger child could 
get a higher Otis ^'IQ,” but could not make ono as low as sixty- 
three, while an older child'could make ono lower than aixty-lhrce, 
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but would liavp no possibility of making ono m higli us ono hundred 
thirty-oigiit- 

Similar conclusions worn reached in nn curlitu study^ bfificd on Iho 
actual IQ’s obtained by Riving Forms A luul H of llio Otm Hclf-adminia- 
tering tests and at least two Slnndnrd-Uinel IchIs to throe hundred 
twenty-two acliool children ranging in ngo from ten to (liiftoon inclu¬ 
sive Those children who according (« iho Slanfoul-Binet teats 
poaBCBsed an average grade of lulclligonco woio found to be about six 
points lower on Lho average in Dr. Otis moiiaurc in Form A and two 
points above in Form li. At the lower levels of intelligence the 
differences are slightly less, but at the higlinr levels as selected by the 
average of two or raoro Staiiford-Rinct IQ’s (ho Otis measure is 
markedly and consistently below that of the Blanford-Ihnct, especially 
in Form A whore the average difference was about twelve points 
at the Binet IQ level of ono hundred twenty to one hundred 
thirty and about seventeen points for that above one hundred 
thirty. These are median diffeionccs, (hero \von\ of course, many 
larger individual differences, fifteen per cent of those with Binet IQ’s 
above ono hundred twenty-four varied by Iwenty-rivo or more 
points, all in the negative dtrcctions 

Thus the Otis “IQ“ is seen to differ from the Binet Ki hy an 
appreciable amount near the norm and to differ markedly at the 
upper extreme. It is difficult to see any juslilicalion for applying the 
unqualified term “IQ” to a measure which diffi'ra from the BUuulard 
IQ to such an extent. It is strange that Dr. Otis should propose 
doing so when ho writes on the same page that: 

It seems tliat the term "Intelligmco Quotient” is coming to hove a legal recog¬ 
nition, but IQ's ns sonictimes derived from group losls of menial ability lioar 
little relation to IQ’s derived by the Binet Tesla’ . Unlohs it is dietmclly 
understood how IQ's wore derived . they should l»o dcfiignaled hy aoino iiicans 
such as National IQ's, Olis IQ’s or Dinct IQ’b, Tlio term "IQ” when not bo 
qualified or understood, must be mlcrprotcd ns lofenmg to actual Intclligciico 
Quotients found by means of the Bind Tests ’ . Uis llio pui]) 08 o of the author 
to use the term ‘'IQ" only m its ongiiml flignilicaiirc » 


’ Oattell, PflYonia. IQ'a and the Otis Measure of BriRhlnrsa, Jattrnnl of 
Educational Hesearch, Juno, 1030. 

’“Otis ScU-adminiflloring Testa of Mental Ability." Iloviacd Manual, p C. 
*Statistical MothodB in ISducationnl Mcaaiiromonts." World Book Co., 
Yonkers, New York, p. 16Q, 
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Yet in propo‘<inK iiiH now inonBurc of briglitncfls which has just been 
shown to differ from iho both m its moaning and niethocl of deriva¬ 
tion he appiirondy liehovoa that he is adhormf; to his statement that 
“It is the purpose of tlic author to use the term 'IQ' only in its origi¬ 
nal significance*' when he writes* . , It scorned best simply to 
call this new nieasuro of In ikIiIiiosh an ‘ ” 



PROGNOSIS OP MlIUTIKS TO SOLVIO lOXKRCISKS IN 

GKOMimiY 


WINONA M mtUY 
Oiuvc>rHit> of Ni'liriiskn 

What aic Iho abilitit‘8 oshmUiwI to the hoIviuk of Mic vario\iH <*\cr- 
ojsos coiifjontijig liic flUuJml of plane Ki*oi«i‘tiy? Siiin- iL jh poHHiblo 
that these nbililioB niiiy bo component, pints ol "genetiil naeUigencc,” 
analysis of inLelligoncc tents might be the ineium of detecting tlic con¬ 
stituent abilities. Accordingly, twenty-«iN gioup intolligence tests 
(or forms) were examined and their content obw'rved ns vcibiil, muncr- 
ioal, or spatial in clinractor. The sepuinle elements, nnd subtesls 
too, were annlyiied fuithor into (J) rtbihlies to pmceive .singly (as in 
recognition of the name, snsc or location of an object), or tu peicoivo 
several objects for the purpose of compaiisons of Himihir or non-siimlar 
meanings, shapes, or amounts (as in acnUiig to denote relative amounts 
of beauty); into (2) abilities to recall word nieinnngH, utlnbulcs, and 
relntionshipB; and into (3) ftbilitles in purp<»sivp thinking: To discovGr 
relationship (as in number series, iimilogie.s, ami mixed Kdations, 
disarranged olomonls, completion of wmlenees and pictuieH), to juilgo 
the possibility and correctncBa of slattMuenis, to apply a ininciplo 
singly, and to weight clomcnls (as in finding the best iinHwer, the 
correct pathway, and in dealing with certain eh'nuuilH infiM’i'nlially). 

Which of these abilities aie nclccled and oiganizt'd into llio Boncs 
of changing responses occurring during tlie proce.snes of solving geo- 
motrio exorcises? Perception is esscnlml; perception, in leimH of the 
given figures as a whole or in parts, is dependent upon the lecidl of 
meanings of figures, of relationships, and of propcrticH, i.e., a sufiicieiit 
degree of meaning or familiarity with voeabuliuy units is nocessaiy to 
note and to follow commands or quesUonB la tcims of the total figure 
as given, or its parts, or the relationship between those imrts Not 
essential, but usually following this scries of perception.s m their motor 
expression in the drawing of the figure described and m the Htating of 
the facts given and those which are to bo proved; lliis combination of 
responses icsults in poicoption of known relationships in tho iiguic as 
drawn, llccall in tho light of nnalysia means pertinent recall wlilcli 
immediately makes available tho needed meaning of ceitaiii figuies 
previously reacted to, or their nature, lelationsliips, or piopiMties. 
Very ooraplicated is tho aeries of responses, "purposive thinking/' 
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which IS to dpLormino I he link that conn(>clH tho conclusion—to bo 
judged, diawn, or proved- willi the recalled and analyzed facts. Tho 
more major responses included under puiposivo tlnnkmg may bo 
indicated by these (lueslioiis- 

Whieh elenienls among I Iioh* reetdled “iit in ” witli ibe. conoluHion? 

Winch elements among liiose amdyzed m the light of tin* figuro 
“fit in" with the eonelusion? 

Winch ones among the pertinent leealled elemeiita differ from, or 
arc not included among llie pmlinent analyzed facts? 

Ifl evidence iivailalile to help ni (iiiding Ihe one element necessary to 
complete the identilv belween the senes of analyzed imd of recalled 
facts? 


U, 


’K adingona! of a <uifMlrilulcrnl 


Ml Ainiig of 

biflccts lluise aiiglcH wIidho 


vertices >l joins, (he ilisgoiial 


Hlaliuiient 

divnlcH the figure into two 
.equal Irianglcs 


as a wlioli* 


fill 


fill 

11rawnig tlie 

/ 

\ 




figure. 

/ 

\ 

fill 

—.fi, 




r 


Motor 





fiu 

FAprcsHHui 

fijj 

'Sl’Uuig what 


J 




iH given 't'o 

\ 

/ 

/ 




he jimvi'il 

V 


III 1 

Pererptioa of conclii- 
nioti, Hint trmiigicA arc 

fin 

Perception of total' 
figure, fi (lundrilalcrnl.^ 

fill 

Pereeptinii of rclalion- 
ehi]) lietweon parU of 
figure, dingoiinl hnieot- 


irig oppoHile nngleA 

|fii 

Pereei»tioa of hnnwn' 
relationHlnpH m figure . 



In A A HI) nnd 

/I M /2 (bven. 

, liii /'A “ /1 (livoii 
UrnUl m the liglil of 
anrilyHiH 

(’oiuUtu)iifl for e(|\ial tri- 
lUlRlcS 

- n - «) 

/^}(^ ~ H - n) 
l{u(n “ R - fl) 


->lt, 



Wliirh eh'iiii nl*! of fi| joh) //< 


elejiitoit, or elc- 


"ht III" widi fill? 


iiieiUs in iMiiliffcr from 

-fii 


-ifi, 

those III id? 


'Two puirn of (’(|nul ioikIi 


III! hiiti'd Hide 


in fi| loid fill 



l^ocH HI) in aAHD eipial 


<'oui'lieiion Ilf eipinl tuiingles jiroveil, 

HI) in ACHirt 

‘/d 

(<l /I rl) 

Yen, "eominon." 


'Chun, 111.. Hide, ii/>, ih the unifying 


or link fiu lor helween tlie dcHired, find 


givini (Old reeiilli d fliets 


Does tins completion of tin* identity !)i‘tvveen tin* two HOiies of 
facts lesult in a unified gioupmg, tn (;las''ifi(!ation, oi "gestalt" of all 



008 


The Journal of Edwaturml PByrhoU>(jy 


tlio fftcts concorned? Furthermorf, dovn rcrognilion of auccoks follow 
tho Bolution of tlio exoreme? 

I'licao nnalyfica are llluatmlcd in lli« oxornw wliown on p. OOr). 

Thoao analyst's Ifid to Urn conslrucllon of a lest progiioHlic of 
abililics in plane Roometry. Tlio pilualioiiH and the lesponwa to those 
slluftlionB arc nujnoricul ami verbnl, aa well uHupiilial in content. Tho 
number and grouping of eleinonlB are to leal tlie eonij)le\, organized 
abiliticB and cerlnm of Uieir consliluont putts, in order to reveal tho 
status of each Btudonl’s abdiliea in perception, in recall, and in pur¬ 
posive thinking; llioy serve an additional purjiose, nlso, that of ilifter- 
entiating botwcon errors due to carelesaiiesH and to inahilitira or low 
degrees of those abilities. The aludniits' slrengtliH and weaknesses 
thus detected may liccome the guides toward difTerentialed teaching 
emphases. The teat includea clpinenlH in tho form of directions to be 
followed, detecting of similar figures, recall, di awing and judging of 
concluaions, detection of correct rcasona from claRsificd serica of slatc- 
ments for stated stops in geometric oxerciscH, and motor expression 
of spatial imagination. 

While this lest was being conslmcled, nnolher test appeared— 
“Orleans Geometry Prognosis Test." Allhougli the purpose of each 
18 identical, tho philosopliy underlying the cmmlrnetHm of each and 
tho nature of tho content are strongly contiasling. T'lie philosopliy 
of its authors (Orleans) seems to bo that prognosis of student abilities 
to learn geometry is best accured by student responses to varied sam- 
plmgs of geometric situations; i.c., that prognosis of liow students will 
learn geometry is by means of how they do learn when responding to 
actual geomotrio situations. On the central y, the philosophy under¬ 
lying the test (Perry) first described is that the more efTicicnt piognosis 
will bo effected by means of tapping the students’ potential abilities 
which, when directed, can lead to effective inaBlcry of plane geometry 
Tho "Orleans Geometry Prognosis Teat" requires: Detection of 
identical meanings, of named angles, of angle size, of coniplcmeiilary 
and supplcraoniary angles, of relative angle and side positions, of 
equal angles and of equal sides and double lengtlis of line-scgmentfl; 
perception of Btatemcnt meanings duo to perception of nmiked equal 
parts; mere deteotLon of “if* and “then” clauses; aiul puiposivo 
thinking duo to tho soieotion of coricct ronaona fiom a given senes of 
unclassified statements. 

Both tests were given, though in reverse order, to students in 
two classes in plane geometry m Lincoln High School during tho second 
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semester of 1020-1030. .Siiico flii» pniJora of RtiideiUs wJio wore repeat¬ 
ing tlic course or who w(ue uhsonteoH on one day could not bo included, 
thcie wore forty-two Htudents whow* icsponseH to tlie oloinents of each 
test were Btudied In detail und eoinparalively. In addition, tlicro 
were two inethodH used for nieuHUniiK llie ncliieveiiuuih of tlu‘Re stu¬ 
dents following th(‘ir study of Book I: One was tlie study of student 
responses to Test 1 of "Ilail's (leonietry Tests," u tost which is a 
part of the legular class woik m thin Hchnoi; the other nieaiiH wme tlie 
grades assigned by tlie <'\im iiistrucloiH, aUhougli the teachers’ esti¬ 
mates of studmit acluevemenl were influenced to some extent Ijy the 
respouaoR of tliesc students to the Ilnrl lest. Studonls’ relative posi¬ 
tions according to llimi total scores on each prognostic test, also their 
IQ's,* wcie clmi'lod with their achievement positions indicated by 
total scores on the Hail test and !)y inslruclois’ grades Two tech¬ 
niques, tlial of llie Peai^-oii l*roducl Moimml IHelliod and tliat of the 
Pearson Coefficiimtof Mean Hfiuaie Clonlingimey, were used to meusuie 
the relative amounts of correlation di*lecle<l by each of those three 
methods of prognosis and two met hods of deleiminmg achievement. 
The total r's are staled in the liral part of Table I, the partial ?’s, with 
IQ's "parlialled out," in the weond i»ail 


'I'ami.k I 


'i'otid r'H hetwei'H iiK’tliadHdf di'UT- 
ininiiig |irt>KHoHi‘< iumI aeliieve- 
laeiil III gisiinolry 


Pnrliiil i’h, (r’H from 
U^'h have liri'ii 
liiirLuillcil out) 



Perry 

^ OrleniiH 

IQ 

Perry 

Orlouus 

Grndo 

.111 

m 

48 

40 

.OO 

Hart 

n.t 

78 

3f) 

.60 

42 

IQ ■ 

1 

70 





From these tables, and espeeiully fiom llie latter pail of Table I, it 
appears that OrleaiiH' test iliawH llie more lieuvily upon lutelhgence 
as estiinaled by (li<‘ 'IViinaii (ii<mp Test of Miuital Aliility This is 
noted from the diop <if .12 m lla* ineasuiement of tlie corielation, when 
IQ’s have lieen puilialled out, iielween the Peiry lent and lli(! Leaclu'is’ 


• Tlio IQ'n, (jl)luuii'(l rr<mi the tili*s in the oils o of tliu lii^h Hchool, lao deter¬ 
mined by Ibo Tenniui Ciruu[> Toiit of Mentnl Ability 
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grades, and similarly a drop of .10 hplw<'eii OrleniiH' test mul tenchors' 
grado.s. When aclncvpincnt ib ileloriniiicd by llu* scores on the Hart 
test, there is a loss of .07 in the piirllal "r" from (he lolal "r" between 
scores on the Verry and on the Hart tests, Imt sirnilurly a much larger 
loss of .30 between scores on the Orleaiwand Ilarl teslH. Furthermore, 
since the partial r's (.‘10 and .50) am nearly idendcal, but the partial 
r (.50) 18 much larger than the partial r {.‘12), the I’erry an<l the Orleans 
tests scorn to prophesy achh'vement (•<iually ivell tf achievement is 
estimated by leaoheia' grades, but prognosis from hcore.s on the Perry 
teat 18 the more cfTicient tf achievement is measured by scores on the 
Hart teat. (Student time rcfimied for responding to the Perry and 
to the Orlenua teals was forty-five, and wwiMily inmules, respectively.) 

As the number of cases is small, further aniilysis of correlation, as 
detected by three motliods of prognosis and t\u) iiiel boils of achieve¬ 
ment, was accomplished by nieiuiR of llie Peurson Coidlinienl of Moan 
Square Contingency, Approximately equal proportions of the range 
of scores on the Perry and the Orleans tests, and those parts of the 
range of IQ's as used m tho (lifforonUalion of cIush nuunliors, wore 
compared with tho tcuchcrii* grades,* ns interproled by llio school 
admlnlstmtors, and with tho publlslicd (|uariiles of scores on llie Hart 
tcatj these appear lu Table 11. 


Tahlh II.—Studbnt I’laobmrnt AccoitniNn to Phoomosih asd AeniPiVKiiRNT 

Teat 

Perry 

Orletins 

IQ’S . ,, 



* Tho grades, (1 and 2, 3 and 4, 6 and 0, and 7) nro inlnrprptod iii per eoiils (in 
the mntiea, eighties, sovonties and bolow aovonly, or “failurn”), rcBpectivcIy 
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The PcarKon (looninciitsof Mm Sriiiarc (Vtiitingcncy/ cnuipuled 
from Table H, are Htatcfl in Talilr lUi (Tim lunoniitu (if tlmwc ('(K'fn- 
cicntB could not v\cm\ H(]{i *) 

TAIIiaJ IlfJ - I’lUHISUHtM AVIl At irif,v»AfrM 


\ IVrrv (Irli-nnn ! 



The (lifToronccH IhTwcimi I he f-Va of llic IVrry HcorcH iiiul tlu! inciiMireH 
of achinvomenli mid Ihc coaesMunluinfVHof llm ()rli*iuiKHpoi(*s and of 
the IQ's, I'UnKo from “ 12 (hiounli .lUi to .12. Thus, iiltliiiiiKli Ihcrc is 
association lirtwcen each iiiHliod of prnunosiH and of iiehii'vi'iiieiKi no 
marked fluperionly m their tneuMiremenl waHehowii by any one of (hti 
techniques u^^ed 

In conclimioti: PioKHomH of iilnhlU'K to ntlve e.MU'ches iii ^fcoineliy 
seems the mine ellicieid, when lm‘'ed itpon uimlveia of the reipiihite 
abilities and their coiirflilueitf pints This niuiih of iiiohiiohi.s fperry 
test) not only requires less student time l»ut il also tluplieules less (hose 
abilities interpreted by the UiV, Iluiii does the ()ileans le^i, Scores on 
the Perry (iiioinetry 1 ’iokuosih' lest are provinn indu'alive of aludeal 
status 111 achieveniiMil, and fnitluiniore of infonnaiion eonei'rniug 
atudonisireiiKtliK mid weaknesiMh infoiiimlion of piiianiimnl iinpoi- 
tancfi to the teacher wiio in to diieet the leiiriunff of the sliidenls id 
piano RCOineUy, 

* Tito ((‘Hiiiii|iic for titiiipiUiiia nailninUi m rilicd m "An Intnidnc- 
tioiito the Thcttiy of .Sl'itisUet" hy (I I'diiv \iile (pi». 011 07), !iIm) in "SlaliMicft 
m Psycholof^y niui )» K (l.'irn ll (]i|i l!ir; liOA) 



THIO DKVKLOPiMKN'r OF MKNTAL AinrA'PY AT THE 
COLLKCiK-ADTTT/L’ LKYKT. 


NIFLVIN W. WJilOllT 


Ihuv'tfrHtly i)f PohiiHylvniiiiv 

K we inwy dofme behavior m llie ri‘4pi»i«<‘ of an or^aiuHin to a 
stimulus aiUmtian, ilw possible ihiiiaiuore coinpU'lo koowlcilfti* of ilio 
organism, may enable ua to make more acciiriile prndictiona, with 
respect to 8ul)sequcnt behavior. Fxpenenco haa shown that tlicio is a 
high degree of corroltilion, between the Btntua of menial dovclopmont 
and the quality of tho porflonahty producla. 

Most of the investigations of ^lenlal Ability, havo been confined to 
ages ranging from tlirec to eighteen years Tina ia parlially due to 
lack of materiftla and methods for invcaiigaling the menial growlli at 
tho liighcr ago levoia. Furthermore, while it Ima been generally 
assumed that biological and (‘nvironnietilal fuelora bolli conlnbutc to 
menial development, but little progress baa been made iii analysing 
tho contributions of either. 

Tho present invcaligation was underlaken, in order to cletonnine 
what progress wus taking place in inoulid development, at the (iolloge- 
Adult LfOvel, an ago range from eighteen to Iwoniy-thrco years. 
Secondly, wo propose to analyze this nicntiil growtii m sucli a way as 
to reveal tho relationship between biological nspeclH, and those 
which may bo attributed, moro directly to onviromnentul [nessures. 

Terman has pohitcd out that though tho Ihnut Hcule docs not 
properly evaluate ohildrcn who test at ono hundred tlnrty, beyond the 
fifteen year age limit; ihia “does not mean that dovelopmenl ceases at 
this time, but merely that the Slanford-JJinct (loos not measuio it.” 

Thorndike gives a parabolic curve, resembling tlio loiiimng curve, 
rising rather abruptly from six to fifteen or Hixtceii yeais and then 
approaching a plateau which he dcsciibes us, ” tlio proliable form of tlic 
curve of intellect in relation to age."® 

Thuratone has shown a menial growth curve, baaed on Ilinet test 
data, for ages thico to fourteen years, conceining whieli lie aayn, “A 
striking feature of this curve is that it conlimii's to nao (‘vi*n at tlu* ago 


^ Terman, L M . “The IntclUgonco of School Clnldron ” P. 147 
® Thorndike, E. L . "Tho Mcasuroincni of Intclhgotico " P C 
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Oil 


of fourtcoii yc!\i-H, willi no inihritum of a lovcl. It corliiinly 

looks as llio Iha kind of inldlinoiicr which is inmsuKMl by IhnoL tosfa 
and their vunalioiia, cnii(iinii-s In kiow as riipidly at fourleon yoaiH as 
it docs at nine 'rins coiicluMDii confmilirls the HtrLlcinenl freiiueivlly 
made, to IlKM'iTrct Dial lost mtflliKciicc iipprouehcH an adult and inoic 
or less stable level at hujrleen to Hixlaen yours Tlio appeaianm* of 
these eiuves, mdieales I hat (ho i^rowlii of tost mlelhgence oonlinuos 
beyond the a^e of foiiriron youM . . . ('o/nnum sense judKinetit 
certainly favors llie assinnplinii I hal Iho iivorat^e man of forty years la 
moreintolligenl than llie avoruKo hoy of iwonly, hut so far \\g have not 
been able to meaaure that difforonro. limloud of acknowledging this 
limitation in our measim'moiil iiiolhnds, wo have not mfreiiuciUly 
attempted to juggle with the doJinition of intolhgenco, to make it lit 
the incasuring devires that are :tm'''Sil»lo 

There, are tliree curvch tn (lie graph to which T1 uiimIoiu‘ refera, ail 
approximately parallel, one of winch roproMUits the im‘an nhilily of 
successive ago giimjis fnaii ihna* (o fourteen yeais on Jhnol tests. 
The second repres<MdH thuso who had a plus one sigma rating above Iho, 
means of Ihoir respective age groups, and Uu* lliiid represents ihone 
who had a minus one sigma niliiig, Isdow llio mean for (lieir lesjiective 
ago groups. All tliese euivoH show a conelalion of lieller than 97 
between lest ability and age. 

In a Inter nrlicle, ThurHloiie has I'xteiided tins curvi', liy using 
similar data, for iig(‘s thr<'e to srvmitoen yeuru, and inlerpolatmg (ho 
curve buck to birth. The main pail or cendal (‘xteiiHion of (ho 
original curve, from lluoe to fourli‘oii years i.sshglilly modilied, ho that 
in the later cm ve, an indecdnn points dovcIopM hi'tween the lunlh and 
twelfth years, possibly ahotil the eloMmih \ear, l-Vom birth to (be 
third year, Iho curve .shoves positive ueeeleralion, wliieli eonlmuos to 
the eleventh year, while from llio fouiloeiilh to the eigbleimtli yeui, the 
acceleration becomes abmit iMpialh negative 'I'liis curvo is shown 
in the diagram attaehod to tins jiiipor 

TliursLone concludes (hal tbo inenlMl giowlli emve m uHymploUc 
both to absolute zeio and !»» an inliill level 'The l<»\\i‘r limit, is (‘slali- 
hshed at at blrtli, the limit m not aseerlinnidih* liy eoiiipu- 

tation. "TIu'ho (iiidingH eonliadiet ihe )i>pothet kmI menliil growth 


‘Thurfiloiio, I, L. A MetliHil <if is'idiiig I'lijeJmluKU’ul TriH yeurmil <<f 
Educaltonal Puydwlngy, yu\ XVI, No 7. |» 112 
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curve of the text bookB, which ih UHUiiIly i^hown lo luivo nofralivc 
accolcmtion from birth without un inflcctum point."* 

The present invPHliKtilion ntUunplM lo iiwnifiure the d(‘vclopment of 
mental ability that lies l>eyonfl tlic niiiKP of Ihnet hcuIpk, (i« reported by 
Thurstone. It further Becks lo imcurliuii wlmdirr mental development 
hoe reached the plateau Blage l>plwr(*ii llie agea of aevenleeu and 
twenty-three, at the Colk’R(*-AdiiH 

Thurstonc regardH hin wcond iiiciHal growl li eurv(‘, ns giving a 
"better picture of continuity for inciilu! giowth regarded ub a. biological 
function." In pursuit of wmilnr inforiimlmn, we luvv(‘ oIkihcji a bniiery 
of tests, which we believe will give «t> index of ilie ciintmuanco or 
decline of thin biological pimsc of ineiilal growth. 'Wo have cliar- 
aoteriKcd this phase as Fundaiiiontal Aliility. 

We have also cliosen a second haflery of teals, wliieli will evaluate 
another phase of mental growth, which may 1 h‘ diduuMl as Complex 
Mental I’roccBsea. T'lic former may ho coiiHluiod as concomitant 
with biological growth, while tho lutlor ropresents tlu‘ ofTect of edu¬ 
cational and cultural pressures. Tlio snme toHls wore, preaentod to nil 
ages from eighteen to twenty-three on the nssiimplion that tlieic wns 
equal competency within the group. T’liis uwumplion was justified, 
In that all ages scored praclicnHy over the same rnngos, m all tests, 
with varying degrees of frequency. 

Tho results wcio obtained m the payciiological Inboiatmy at the 
University of Pennsylvania, from college men and women, dining the 
three academic years, 1927'-1928-1929-19!10, an part of Uic reijuired 
work in psychology courses. Tina tcaling program waa instituted by 
Dr. Lightnor Witmer, and has been developed over a number of years, 
by instructors in the clinical laboratory sections of first year psycliology 
courses. 

The tests, to which tho aludenta were subjected, wcio Used as 
didactic experiments or demonatrations. Tliey wcio admiruslomd 
under standard conclLtions and procedure, during tho courso of twelve 
class sessions, by a number of inatructois, and scored on established 
standards. Tho significant mcoaurca for each tost woie donvod fi om a 
combined protocol, of tho various groups that luul taken the le.sta. 
More than eleven hundred atudenls liave been tohtod in this miumor 
during tho three years, and have contributed lo tliose reBulta. 


•■Thuratono, L. L.t The Mental Growth Curve for Binob Testa. Journal oj 
Edwaltonal Psychology, Vol. XX, No. 8, p. 600. 



Da'vlopmnii nf Mtninl Ahthff^ 

Dr. Brotoniarkic, under whow .supervision these rourAcs were 
given, conceived the ideii of iiHiiig (he miren (o develop a "Miuitul 
Graph,” by ineiiriH of which MinoiiH types of studf'nl alnlily imglil he 
portrayed graphiciillyd Oni* of flie distinctive feufuroH of (iim Moutiil 
Graph, is tlie unalysis of Mental Ability info l\so piirf^, whieli !i(* 
designates ««: (I) Fundameidul Abihdes; ami (2) f'ouijdex Meidid 
ProcesBCfl In evaUmtiiiK any |»eis(iinih!y, or Us prodnel^, j( ih 
manifcfllly of gieat mipoituiiee, from hofli (he diiignostie and prog¬ 
nostic points of view, to Know whether an imlividual'M inh’nonly «»r 
superiority, can he traced («i eUlier «irie or (lie other f>f (wo aspects 
of his Mental Ability. Meji'-urement on the SJaiiford-liinei, and ntiier 
group or indivuiuiil lestK, alToidK no such in'<igh( 

The pragnialic vindieatinii of lliia proeeduu* is evidenced liy the 
types of grapli acltiallv obtained in practiee, winch Or. iirotemiirkle 
divides into tlie following seven chi'tM'H. 

1. Superior nieaning Mt(K*rior in I'ufulufiieiUal AlnlUy and in 
Complex Mental Iboec'-xe^* 

2. Superior dcscerahiiK meftnIiiK superior in lumdarneiifal Alnlity 
descending in t'liniplex Mental rroei^-Nes 

8. Median asmtding meaning nndnui In iMimlameiUal Abtlily 
and ascending in ('oinpl«‘\ Meiilnl Procf‘<''es 

4. Median ineamnK me<liatt in humlamerda! AbdUv and t ‘onip}<‘<i 
Mental Procesnes. 

I). Median descending meaiititg median in ]''nn<laiiienfrd Abdtiy 
and desconding in t'omplex Meninl Proce.-'-ex 

6. Inferior uw'nding meaning inferior in KmidameiUrd Ability 
and ascending in {‘oniplex Mental Pioccsm-s 

7. Inferior meaning mfeimi in bo/li I'niidamental Ability anil 
Complex Mental Pioeei-ses 

It is by no means ineviiaiF)}* insured tliat on individual uiili a 
superior endowment of I'und.unental \hilUy, will jHuforee imiiaih 
superior in t)io iielrl of Complex Menial i‘roee‘--es Xoi is U a'-siired 
that a median enilowmenl of Kundninenlul Abililj , iii!v\ not rise or fall 
in the field of Complex Meiitn) P)iMe‘'ses Knun llii'ho imiJings, U 
became npparmit (hat any eHliinate of the giowlh of ineiUiil ability 
at tlio Oollege-Adiill I,evel, niiisl la^ aimlj/ed, iml only wuli ie,s)>(el 


'Brolomiirklo, It CaUige Muihsit IViHiiiUi'l rruhleuifi yntit/iu! 

^hpltcd Psycfiohffi/, Pol Xf, X'o « 
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to iiicrpnfliiig nRc, ljut olw) wuh it.him'cI to flio ilcvi'lopJnonL of thcRo two 
pliwws of iiiontul ftbility. 

Our invodtjgftlion concoriH the ucliiovonionlH (>f iho various tigc 
groups from aovcntcou to Iwoiilj'-lliriM*, coniprimuK [Iip College-Adult 
Level, m thoBO two fields of MeiUol Alidity. In filming the age 
groupfl, each one was made lo inchidi* all indlvidual.H vs ho Imd passed a 
given birthday, but bad not passv'd llie agf* lev<d of !be lUfxt Inghor 
group. Thus the eighteen year old group compriHeH Ihose wlio have 
passed llieir cighlcenlli birthday, but have not yet readied Llic 
nineteenth. 

The results obtained by the Boveiileon year old group, aio not, to bo 
regarded ns highly fllgnificant, owing lo the very few eases available at 
this age level. Tlio Lwenty-lUree plus group, reprewMils a small 
miecelhuieouH company, ranging from Iwenly-iliree yiMirs Lo us liigh 
na 40 years. Their liotorogeneily and liimled niiniber [iliice a high 
degree of umeliability on the resulbs oliliniu’d by tliein. These facts 
mual bo constantly home In mind, wlien reading tlie exlrcinilies of our 
aubscciucnt lalndalioiiH. 

Moro than eleven liuncbed Btiidents were tesled, though not all of 
those look nil of the tests, duo to abseiicoH atul interniplionH of thclnbo- 
ratory sessions. I'Tom Ihia miiKHof iimleual, we Imd avadable, between 
six hundred and sovon Ivundred semes for eneh test, alioul oiiunlly 
divided between men and women. Tim seoieH were gioiipod in respec¬ 
tive piotocols for each ago level A HubHecpiviit inveHligalion of tliose • 
results will bo conducted, on the basis of sex, lo ascerliun wliaL dilTcr- 
encca may prevail between them. 

Wherever we had a acoic, belonging lo au individual of a piirUculnr 
age group, it was recorded, rcgaidlcM of liow nutny of tlie twelve 
teata, the individual may have iniaacd Our final reHulls uie therefore 
more significant, from the point of view of nchiovenimit in ii'liitioii Lo 
age, since the resuUs of no two teals, include acoies liy exactly and 
exclusively the same individuals. Nearly nil llie aludents look iihiiost 
all of the tests, but some who took tost number two, for e.xaniple, may 
have missed tests three and five and uicc versa. Tho rcHulls thciefore, 
arc based on scores, belonging to certain agi* gioiips, ialh(*r tiian lo 
certain groups of persons of a given ago. 'LIuh factor disfads, (o some 
extent, the possibility of a fortuitous Bcleclion of Hubjc'olH Ouis is a 
random sample of the College-Adult PopuUUion. 

Following Brotemarklc’s nnalyaia of Mental Abilily into (ho com¬ 
ponent parts of Fundamontnl Ability and Comjilex Mental Proces^^cs, 
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the BIX te8(H which wore uw«l (o inouHurc* each one of (licse factory, in 
this invcHliKiUion, iiro liHtod l}ol(»w. 


I'CSUAHIlNTAt. Al)linir.a, 

Na«ph ‘ir TuAtfl 

1 Momorv Sjuin h»r DikiIh 

2 . Memory Sjiun for Svilnlile^ 

3 . Memory 8 |mii for Menu 

4 . T/iylor Number TcJit 

6 . AuBuage (IJmliriTli'fl AUen(ioii) 
fl. Ausfrngo (Djreen’fJ AtU’Ulion) 


(oMtirx Musiai, 

Sawra tir 1 r,nTfl 

1 OpfMiHileH (Itobfirk) 

2 AbKlrrielum (Iltilinrk) 

.1 Kefi n u( e (Uolponk) 

4 Delimtion (IlroteiDArklo) 
T) JiidKinenl (Itoback) 

<} 'IValtju* iHcnJf' .1 


These tesU liuvo been prcsi'nlecl imhvuluiilly by Iheir aulliors and 
subjected to analysis l)y HroU'inarkia' and Miller ® It is sufliciont to 
indicate their giMicral cliaraelensticH and the difforcncca between the 
two batteries 

The battery used for cvaluatinK Fundainoiitivl Abilities, flcoka to 
ascertain the relative jilaaticily of the oi^amzcd jirotoplasm, Its 
impressionability. The ineiiiorv span tesls tue almost us simple ns tho 
patellar refle-v, but limits of aclimvemenl vary with tho mdivlclual, ao 
docs tho oxcurmon of (he fool in tho knee jerk The jomnininp; three 
In this battery, arc used to explore the tield of attention. Is the 
individual alert and ieoe()(ivo to t]i(‘ world about Idm? To wliat 
oxtent does the world intrude itself upon hm perHonubty, and inakc 
impressions u[)on him. 'Phesi’ lliice offer another clue to tho indi- 
vidual's plastJiJily, lim impiohsionubility, Ihn ease or diiliciilty with 
which ho can be moddied or adjusted to his cnviionmcrit. 

The tests for Comiilex iNfenlal Pioce‘i‘,oH, investigate a different 
aspect of mental function in persomdity Ileio weobseive nml seek to 
cvnlualo, the influence and ichuUs of tiaimng and onvhonincnL, the 
height of tho cuUinai level, liic cloiunohs or obscunty of thougiit 
processes, the jiowci of abstnicl tboughl,, llio ability to construcl and 
compaie concepts, keennesH of discnminalion, the piecision with which 
one may cIcHcnbe or (letme, mid ho on. Tlie whole range of complex 
mental functions m pi'isonality invites our inquiry, but at beat, wo 
can only select a few Hamples in tlie diiectioiiH in(licaLe<l above. 


I Brotmnarlvlc, U A.: (killi'g*' HLuilenL I’c'rwiimi'l ProblimiH, Journal of 
Applied Payrholoyi/, V()\ XI, No 0 , 

* Millor, Kiirl ( 5 ; 'riui CJompoUmcy of Fifty ColleRO .Hlndoiils The Vsy~ 
c/iotoflicai Cltmc, Vol XIV, Nos. 1-2 
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Wo have treated llie results oblnined hy Ihowi two batierieB, 
hoparatoly. The scorca for eacii lest for i-Eirli uko ^rou p, wore tabulated 
and llio ftverngo and fiignm doleniiineil A conipOFito score for each 
age group, for each buttery, was llion iIcvoIoimmI. Them* coinpoHilc 
scorcB aio known as the FundaTiionlal Alehty Index and tlus Complex 
Mental ProcosBos Index. 

Tlio molliod of obtaiinng IImw oonipoHilo seoifs eoiiHistod first 
of all in weighting each of the mx IohIs of each buttery wpurately. 
The amount by winch each teat Khould ho wcightiul was detcrnnnccl 
by Iho ratio, which its sigma bore, to the average Higimi of the six tests 
in the battery. That is, Iho iivorage aigma of tlm six tests, was 
divided by each of lU coriaUlucnl sigmas, and the r(*.‘<iilling (quotient 
was the weight olioson for lliat test. The mean of each test was 
multiplied by its iciipeolive multiplier; the resullH suminntcd, and an 
average mean for tlio six tcslH drrivetl, forming a composite score or 
index. 

We have designated this statlslicul pinecdun' as lim average sigma 
method of weighting or combining lo-sL scorcH, lOaoh of the six 
constituent elements of the compOHile mean, Ix^ars the Haine iiuvtlio- 
matical relation to the original from which it was denv(‘d, that its 
respootivo sigma boars to tho average sigma of the ballt'ry. 

This method, oltorod a conBislenl acUcine for treating many 
combinations of scores in both batleriofl, and furllier (diminatcd the 
possibility that obtained icbuUb might have licen inllmuiccd by a 
fortuitous choice of weights for the various tcHls. Tlu'.s(‘ indiccH wore 
then subjected to the statistical nnalyHiB iiKlioalcd in the diBCuasion of 
results. Correlations wore obtained by the Pcivrftou Pioduct Moment 
Formula. 

A method of combining Icatscoics, somewhat similar to that used 
m this investigation, is described by Gnrrctl.' Tho "(Tianco H” for 
multiple Correlation, was obtained by the following formula:^ 


“Chance U" 


V^' 


p Analysib oif llEBunTa 

■The means attained by tho various ago groups in the teals winch 
constitute the battery for Fundamental Abilities, aro found in Table I 


‘ Garrott, 11, E.t "Statiatios in Psychology mid EdiicaLion.” P 2.S0 
* Garrott, H. E.; " Statistics in FByohology and Education." P. 239 
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In as mucli as the populationa of t!ic* vnnouH n^c ^roup3 differed con- 
eidcrably, the greater i}rf)poHion of nifttfieniaticiil reliabdity belongs 
to Lho group having the Inigesl |)f>pulalKi»i 

The scorcH of tlio Hovonli'en year age gro\ip, have been discarded 
in subsequent roinjmlatmnH, IxnnniHO llioir amall number gives an 
exceedingly high degiee of uiuelnibility to IhcHO scori'H. Furthermore, 
diey repreaeiifc a Inglily Holerled grou/i /if ih/Iivk1ii«)h, »vlio by reason 
of an early slarL, Hp(‘Ciul ttnudung, ability to skip n grade, or some 
other reason, reached (he (Imveraily Iiefore their oighteonlh birthday. 
The size of this gioup aa coiiiparc/l with the oighleen, nineteen, and 
twenty year group, indieales llml aoine factor of holection was at work. 
If fcbi.s factor hiqipened to be superior uienlal ability, fins marks llicin 
all the more as a lughlj' selected group of seveiUeen year old indi¬ 
viduals For our purpo*-eH we need rnmloni samples of all ages 
invcatigaled, in KuHieienl numberH to give Home degree of rolmbihfcy. 

The group liHled as Iwenly-three plus, lepiesents iniBccllaneous 
ages as high a« forty and m liierefore not iiuHealivo of any age. The 
scores of (ho twenty-two year old group have beeit tipcd, though they 
mimbor but twiisa (ho me of the Kcventcen year old gioup. However, 
they do not indicate that Hpeeinl fuel oi a contributed to their selecllon, 
which wore not uIh<i applleidde to ages eighteen to Iwonty-une. Never¬ 
theless, due cniiHideiation nivmt he given their smiill population in 
evaluating their indices. 


Tadi.e I—Hmowino tuk Avbhaok ani> Htanuahu D^JV'IATl()N von Each Auk 

(fHOne IS I'ONtlAAlK.VrA/. Aiiimtikk 
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Tabic I gives little indication of lire relative abilities of the respec¬ 
tive age groups, by observation. 
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Table II hIkwh m t^iinilnr nmi»ii<‘r, flip inpaiiH aelncvod by the 
various ago groups In the tcfllK eomprinjng thn bill lory for Complex 
Menial ProcoasoH. Tlie resulln »bi not grenilv fiU'ibliUn I lie dmeovery 
of Ircnda in iiicnii abihly or viirmVnhty, by ob^orvuuon 


Taulb III.-~-8novino tiik fkiMPOHitr, Av^nAoB N-oio, r()» Kapii Aor Gnoon 
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Table III shows Llic rt'SHllH of combiniiifj; Ihi* hi\ Fimdamental 
Ability test scores, into a coinpuHiie or indi*,\j bn (‘iicli gioup. The 
eighteen and nineteen year old groiipa appeur lo Iks Hiiponor lo the 
twenty year old group, and the twenty-oue and Iwoniy-Uvo your old 
groups are also suporior to the twenty year obi groui>. 'i'hi' average 
ago of tins enliro College-Adult Iicvcl, weightt'cl according to tht* 
number of each population, is 19.69 years, while the average mean for 
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the entire group Ih 1*1 0^^ in FunrUvincnhU Al>ility. The mean ago of 
this group of C'ollcgn nclulN therefore} hea hetweeu niueteon and 
twenty ycura, winlo tlio mean ability of tlie college adult id represented 
by a scorn that m closer to Ihc hcoh* of these, two ages, than it is to that 
of any other age group. 


Table IV.— Hhowino tub CloMiamixB Hcoiir roti Kacm Gaoue in CourLtcc 

^^B‘^TAf. PaOCKftSEH 


Ago 

Frequency 

Mcflii 

18 ^ 

08 ! 

■13 8-1 

10 1 

220 

46 38 

20 

185 

40 35 

21 

03 


22 

83 

47 09 


Tiio rosuUs of eomhined scores for tlio C/omplox Menial Fjoccasos 
are shown In Tahio IV. Here the trend toward uiorouRing ability with 
mcicafling age ih more readily ohserved. The hiko of the moans for 
Complc.x Menial ProcesHeH as compared with the hi/.c of the moans for 
Fundamental Alnlity m not indicative, Hincc those hikoh ropresont the 
arbitrary numerical valueH of the renjicotive scales by which the teats 
wcic guided. 

The coirchiliori of Fmulaniental Ahilifics with age is ~h 17 with a. 
PE of 'H 025. Tliih represents a low degien of correlation, yet when 
portiaycd graphically, it lovnal.s some Higmficance The coi relation 
of Complex Mental Piocesses wilh age is + 95, with a PE of + 003. 
The Multiple correlation of age with (Fundamental Ability and 
Complex Menial Piocesses) i.s H- 07 with a "Clianco 11” of d- 056. 

The companson of the resjieetive tieiuls mdiciitCH, first of all, that 
these two hatlencH have tapfied two difTeiorit kinds or pliiiscs of 
ability. One of Lhese we have defined as native endowment, Funda¬ 
mental Ability, or mental growth eonsideied us a biological function. 
The othci Is defined as a Inglily complex inLollectual response to 
educational and cultuiul pressmeH; ic. the dovclopmcnt of Complex 
Menial Proccs.scs From IhiH point of view, mental growth at tho 
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hiKhcr mtHU'cUml Ic*v(*1h I*im nf a lurOojijirMi function and more 

of a rp«jioiiw‘ tn wlcrlcd jirr+^'iiircf* 

It miiyt )>(’ rfrallcd llnil \\r iirc diftlinsi with a chrtuinlnKicul period 
rauKin^ from ciKliIccn lhMUB,li (iinntj-liwi >Tfir«, hfiirc what may be 
Iruc of thciM? j>arlicuUvr ivrcs^, may n‘<l U* irui* ulwivo or hclow (Iwm. 
Until now, the corrcladtui twlwnui iiwntal Kro^Nfh and ii^o for this 
piTjod liHH iM'cn iiOHUiin'd jw jn‘m, wliirli woiihi jrivn iih a plulciiu on 
tlio curve, l^y acUml lueaHiiroMH-iil, of llii* rorri lation, nsc have found 
it to 1)0 whicli Kivi',H a ffraduiil inclun* upward toward iimturity. 

The Irciicl of f'oinplcx MiuUal l*ro«*ww»« ahihty, riWH from eiglUcen 
to twenty-two yearn, with a alight dr<i|i of 11 at lliiH 1 h«1 HtaRO, poJ*sibly 
due to the Hiiiall poj’iululion at thw poml. Jnen'anuiK mkc, lived under 
the atlrmiUiH of eidiiiral and ediicaliomd envirnnjjifMl, Ima provided a 
more c'ctoiipive onenl alum, u richiT barkurouiul from which all mental 
function produclH niuy Ue derived. The fniilH of addiai years of 
experience are nianifcHl in ihe tnuid tuwnrd Kroiiler uhility to mnke 
highly complex respoiiaoK will) iiicri'iudnK age 

In order Vo iwcHent these correlalunw grni>hu'n\ly, the slopes of the 
regression linen were determined hy the fonniila: 


whoro M reprcaonta the alope of llie reKresaion of (1) FundaiiieiUnl 
Ability on age and (2) of Complex Mental l’roc‘(*sseH on age. b 
represents the mean of either array of ahilUy uuheeH, and a lepicfionla 
the array of ages, z and y reproaent dcviutionH from the means of age 
and ability, respectively. The aum of them* dovialioiiH is determined 
by the aizo of the populations In each group 

The rogrcBSion of Fundamental Ability on age gave a cocfHcicnt 
of + .00 and the regression of Complex Mental Pi ocessi'.s on age gave a 
coefficient of +.04. Further reduction of these valiu's to sigma or 
standard units, facilitated (heir representalion on t!u> same graph. 
Tho formula in either case became: 

Ml 

“ v: 

Cti 


where s meariB “standard units" or “sigma units" and ffb m the sigmn 
of the array of cither ability taken separately. Tliis gave (he slope of 
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the rogre-saion lmp« in terms of Rlniulard lunU, that for Fundamental 
Ability becninc i/ -ini-; itntl that for (’oinpbx McMiLnl Frocc-aaca, 
y = .93ar. 

The Ktaiuhirtl lOrrnr for (lii* ('ocfrieienl of ItegreBaiou is obtained 
by the formula: 




ll r* 
iV ' 


whore ffa w llie eigma of lbe»goariiiy;r wiJm ooo/ncioiit of corrohilion 
between alnbty and ago, and the number of ensoa. 

The Slnndurd Krror of tlui Ooofiicient of Uegrcssion, of Funda¬ 
mental Aliility on age is f<»vm<l to bo +.013, and that for Complex 
Menial ProcoHsea on ago i« found lo be + 012. 

The vnluc'H mdiculo tirnt of (dl, the high degree of improbability 
that Ihcse two eurvea (1) and (2) can ever change auHicionlly lo move 
with Ihc fiiiinu dogri'o of acceleration, willnn llic range of eiglitccn to 
twenty-three yeivia, lluia fniiuKiiing tidiled ahauriinco, in terms of 
increased probuliihly, (o any conclusionH juHdiicd by tlioao curves. 

Tlic IiinilH Hcl, upon the nlope of (lie Furidnnicrilii! Ability curve (2) 
by lls slaiulard of c/ior, imhealo IhuJ there i« but very slight prob¬ 
ability llmt the immlal growlh eiirvew d) leacli a plateau during this 
pciiod, III other wojda, Ibeie is i*xeeedingly liigli probability, that 
this porlinn of the curvi* will always line shglitly, and furthermore, 
that Us present location la the most probable. 

In a similar mamuM’, iIm‘ probalnlity tlmb the Complex Mental 
Process curve, (1) will evei reach a plateau during Una poiiod la oven 
more remote, wlh llio aliong pteHumplion that its provsont position is 
the most likely, for any random sampling at the Collcgc-Adult Level. 

Dingiiun I is u gnipliic pieseiUation of these results Our pioblom 
is to reconcile Ihcso, two difTeient aspects of mental growth. It is 
evident fioni iSeclioii 2 of liic cm ve, that the liithorto ns.sumed plateau 
was I'olalivcly Diougli not absolatoly correct. Tliafc tlio curve is 
approucliing a plateau at age hovoiitccn is cei'Lmn, but tliat this 
plateau lies bi'yond twenty-llireo is also cortiun. FundiiinGiital 
Ability, native endowmonl, is still slighUy on tlio increase through 
the twenty-second year. 

Section 1 of tbo dutd curve, icsombloH very much the curves 
obtained for test ability correlated with ages eight Lo fifteen on the 
National Intelligeuco Te.st; also that fioin eighteen months to six and 
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oiu‘ half yofiratin the Slulffnian ’IVm, r4>nl tliu? from (‘lovcii In aixlcca 
years on the this Arlvniire^I nr'- ‘ Tlic rale of ila 

ftccclcralloii w in nliarp cnnf^{^^l willi ihiU r»f Srrtmn 2. The relative 
height above ikiclioii 2 is inMBtnlirnnt, aw th»h jwj'ilKjn \va« arliilrahly 
chosen with rcsiH'ct to other fr-atun-H of ili" dunl curve. The rclallvo 
slope of these two eurvea is tin* Hgiiifiraiit f(irt4ir 


^ t i 9 f 4 l/ffMA UsiTI 



Curvofi Ahowtng llio rolnllvo bIopo of tlio HoRrofMluii Lines, from Agon olglilcen to 

Vvioniy-ttireo. 

1. Itogrossion of Complo* Montnl ProccMes on Ago, clKliteon to l^cnty-threo 

3. Boeroasioii of FundnmonUl AbillUoa on Ago. oigliloeii In tw etily-tlirco 
3> Thurolono Montal Qrowlh Curve from toro to Bovrnieen yours 

4. Tiioorotloal Curve of Ooinplox Monliil Proccea Dcvi'lopinoul, isoro to novontcon. 


It would appear from the shape of Soolinn 2, tlial the imtivr endow¬ 
ment or montal growtli regarded as a biological funetion, ib faat 
approaching its maximum between eighlei'n iiml Iwonly-lhrco years. 


* Thuretono, L L ; The Abaoluto Zero iu IiUolligouco MoaHUioment. Psy¬ 
chological Renew, Vol. 36, No. 3, May, 1028, p 103. 
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On the other ))nn(l, llio iiilellectunl devflopiupjit asid cultural status of 
this snine Kro^)), cnntmurs to mv projiorliouatcb' to Ihcir conUnucd 
subjection to ciiuculionnl ami ciilUnul ournculu. It BCcmH rcnsonrvblc 
to ohamclonw Section 2 na imliculivo of rntlicr ohutunilary mental 
behavior, and Section 1 uh imliruUvi* of rather Inghly complex mental 
behavior. Wo hIuiII prolmhly iivokI Home confuMion in (Iihcushiou by 
omitting Iho doulHful infnrMico Jo “iiilHIiKence.’' 

A further clinractcri'Aiilion, winch (hn’crei^UnlP.s tlicao two typos of 
mental growth, iiURlit rcgaul Section 2 lui llic evolutiou of the inherent 
qualities of the protophiHin a aimplo behavioristic CHtiinato of mental 
growth. The other curve, Kcolioii 1, n'presenlH no denial of the former, 
but roYcalB a Bupplcmentnry aniiect of mental function m personality 
devolopment, wherein the cultural and educational induencos of 
society are mnnifosl. Tins curve shows a much higher correlation 
with chronological ago. Since these two typos of behavior arc pro¬ 
duced by the same liiologicnl organimn each ns inovitablo as the other 
—it would seem iliat every stimulus situation ofTered an opportunity 
for selective reaotion or clmice of inontul function. Wc may react 
biologically, at the uniinnl level, or wc may react na inlolicotual 
personalities at a liiglier level. Perhaps llio greater degree of employ¬ 
ability, tends toward the lughei nUher than the lower lovcl, at the 
Collego-Adult I/i‘vel, especially if w« have regard for llio prc.sont valuo 
of correlation cnedicienls. 

Our next problem is to relate our lesuUs to provious invcatigatioiiB 
of mental growth On the bams of the icsuUsoiitivincd m this investi¬ 
gation, wc linvo attempted to Interpolate both .Sections i and 2 of 
our dual curve, backward to birth. 

Wo have accejited the menial growth curve of Thurstono, from 
three to Bcventeen ycius, as most iiuhculivc of lliia period. Without 
modification of either curve, oui Fundaiiicntiil Ability curve, Section 
2, appears to bo a contiiuiaHon of Ins hiulings With some degree of 
confidence, the cuive frn' nienliil growth, considcicd ns a biological 
function, can now Ix' diawn fiom birth to the twenty-third year. 
From the slmjie of 'rhui.Htone’s curve (3), it is evident that the rate 
of this dovelopmenlal piouess is not coiihUviH It has a positive 
acceleration to approximately the elevenlli year, wlieio it roaches an 
inflection point, 'riieie riegutive iiccelmation setn in with steadily 
increasing swiftness until we. leiicli the hovenleentli or eighteenth year, 
at whicli point it appears to cuter upon a jKiriod of constancy througli 
the twenty-second year, This type of mental growth increases as 
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much or more m any wnglo year, bclttcon wvou and fourteen yoais, 
as it does during tlie wliolo five year perirnl fioin eighteen through 
twenty-two. 

Wc have noted the slnnlnrity our ('oinplex Mental 

Process curve, Section I, and Uie curveH derived for other ages on the 
National and Otis tests. Wr have not. (‘iidenvored to fit our curve 
to any of tlieso as yet, tliough we propoH* to jnake tins attempt in the 
Bubsequont investigation of our results <m (he hasm of nev. Por the 
moment, wc have placed our (loinplex ^tentai Proci-ss curve, Bcction 
1 on tlic chart m an arbitrary manner, preserving only its relative 
slope, and theoretically extending it tonurd j-ero ability. We have 
designed that it intercept the Thurstone curve ul the eleven year point. 
This would bring zero ability for llna type of mental ability at about 
the four year age, if Lho curve were earned through. 

If however, tlio C'oiuplex Menliil Procu“M curve leprcsouts the 
development of a certain type of monlid lieliuvior, we should prefer 
to begin our theoretical curve, pos^hly at iiljiiut eighteen months, with 
tho inception of language ability in the iiitiividual, even though wo 
may not be able to measure it here 

Between its inception, and the mxlli year, llu* f!oniplex Mental 
Process curve (4) m ahnoHt equally accelerated with tlie Piindaincntnl 
Abililiy curve, tliough slightly Ixdmv il. At the sixth year, tho 
individual meets the educationally organized tiurnuii of civilization, 
whlcli 18 designed to shape and fasinoii his menial beliavinr lie is 
subjected to educational, social and cultural pressures, repiohontcd 
by the school curriculum, hia contacts with leaeluuH, and liis con¬ 
temporaries in intellectual compclitlon. Hence at this point, a more 
rapid acceleration of his Complex Menial Pnicean ability lakes place, 
which overtakes Lus Fundamental Abihtiy curve, al)oul the eleventh 
year. From this point to his twcnly-thiid year, our assumed (Complex 
Mental Process curve follows the trend indicuted Ijy our investigation. 

This may account somewhat for llio prmiounceil cluuige that takes 
place in the individual’s mental functioning just befoici llui oiiHct of 
puberty. According to our iiiterprclivo ciirvo, at tbis point, the 
individual’s behavior is determined less uiul lens ijy jiionoiinced 
biological mental rcspoiiBC, and more and inoro liy an intellectvml or 
cultural response. This is in no senRo a denial that our solution of 
many problems, oven at upper age levels, iibos no higher tlian bio¬ 
logical mentality, but it is to say that wc can and do develop potentiali¬ 
ties that make reaction on a complex menial level, just as po.ssible. 
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and certainly more prolmblo. Wlial wc Hpcak of as "control," very 
often ifiea/iH to deluy a ''bioloKirnl iiinilal” rrsponno, /ind refer the 
solution of the tiroliliMii li> tin* lusher level of Cloinplcx Mental Proc¬ 
esses. It IK an oliserved |>he«i>ii»eiion, that n pronounced change in 
mental behavior charnelenzes llie period fiom nine to twelve years. 
Possibly (he wane of luohigical ineiital development anri the con¬ 
tinued increaw' of liigldy eomplex mental processe.s may partially 
account for tins change. <hir iiilerpretive curves ofTer an interesting 
field in which to conduct further mvesligntuius 

Our final consideiatioii m the prediction of behavior. Frequent 
reference to our interprclive curves, will help to clarify the discusaion. 
These curves liavo OHtaliliHhed the noriiutl course of mental develop¬ 
ment. They predict that fifty per cent of the individuals of a given 
ago will he found above and fifty per cent below them, in similar 
samples of llm population. Thm may bo regarded as a general 
diagnosis of mental lielmvior up to the tweiily-third year. 

Prognosis is simply tho theoretical projection of dingnosia, and 
our interpretive curvi's, ofTer the most probalilo diiocUoii for prognostic 
projection. For exnmjde, smee fifty per cent of the populations 
investigated, arc either almve or lielow the curve at three years of age 
and at twcnty-lluce alike, it heenm rensonublo to nHSUinu that the group 
which was ahovi* at llirce Years will also bo. Iho group whicli is still 
above at twcnty-llirer, simply beemwe Dm curve of normal mental 
development lies laTwi'cn theae two groups all the way. Any other 
assumption would di'ny (ho validity of Die normal curve of mental 
growth. It is matheiualically impossible for a point ono sigma below 
the curve at three years, to leach a point one sigma above tho curve 
at twenty-three ycais, without tracing a now curve in its progress, 
which would he entirely difTerenl, than tho curve which wo have found 
to represent normal incnliil development 

Diagnosis ('slablislies tho mdivnlunl’a relation to normality and 
measures his deviations from the iiorinai mental growth curve, on a 
straight lino, porpendicular with the cluonological iiase lino. Prog¬ 
nosis on tlie ulh(‘r hand, conwrns Die movement of this diagnostic 
deviation point, towaid the right, in the direction in which tho chrono¬ 
logical liaso line oxlendH, hid ml paiallH to it. Tho Deviation point 
must move m a curve winch m of the, Hiune general form as tho normal 
mental growth curve. Thm is but another way of saying, what is 
widely rccognw.ed, that bnglit, normal and dull children develop 
mentally at ajiproximalcly tho aamo rate. 
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It l« to !)(' ikKimI himcMr llm* xon iloliiv hro, hence 

posilivo uiul lU‘Kn 1 l^c lurr-w with age This 

fact help*! to iiullinilicnt^ HI 15 pP'Rn^.Hi*, I.-im^iI loi iifcunito dingnosifl, 
bccAOW* It Knoluiilly l)i'‘ •iHloiiro lln* norinnl curve 

and lU'vmtn nirvi'^, with iiirffi'*»iK yt'or**, tloo- luokitiK Ilnur coinci- 
tlnicp nr crofwinR evrn inotf rnnotn 

Tlio KhfHM‘ of On' FuiolniiMoiliil Alolifiv nir\r, Sri'lmriH 2 and 3, 
is an ardonl prolrwi njcnniHt »ny pni^iioMn of uihill Uidinvior, which 
in banofl on an infnnry enrvo. Tlio inont ihortniKli ilmnnoHiH of the 
onn lo two jM'ar jK'nod of iI«k ciirvo, no »i\dioiitnm whatever of 
itH direction Ix'Lwecn t<‘n nml fifleen or InawH’ii oikIiUn-h and twcnly- 
thruc ycarw. Kurlheriium', the riiltund and iiitclleeliinl development, 
reprcaonted by tin* Complex Menial l‘roee«w curve, tN'cliotm 1 and 
d, by wlilch the indivulutd will la* more t-oiiHimilly evnbmled na iiuocml 
unit, are BO inci|ncnt from one to fhe ienm, tlml proKnonm wiili reaped 
to thia phnac of menial developnieiK, In iIiIh penoil, ih very doubtful. 
In other worcia, the doK^ee of acceleration willi winch menial develop* 
ment takes place willi mereaeniK iiRe, 1 r., tin* Blmi>e of llie norniiil 
doYclopmonl curvoH, can not Im* deienmned liy proKiioHm, Kow 
that tlicflo curves have been (leleriiiiiiei) by inveHlimitnm, pniKUofiB 
must follow tho couTHC they indieule. 

Brotomnrklc luifl Bhown in hm “.Nteiilul (ira))li 'I'ypen" that (he 
prcdlotlQii of human hehavior can only be biiHed upon accurate 
diagnosis of nn individual, with ichimtI to ilic two pljueeH of mental 
development indicated by our itilerpreiivi* eurvt'H. A HU[»‘nor bio¬ 
logical mental basis is not absolute nwmrunee of HuptTioi ability with 
respect to the dovclopincnt of (kmiplex Mental Prooe\‘<eH 

This IS only to say that social noii-conformity wlneli reaches the 
acute stage of variability in criminal ucIh, ih juHt uh freijuently the 
conoomUant of normal biological mentality us it is of abnormal 
Conversely the normal biological mental e^do^vmeIlt is iputc capable 
of attaining high clegreos of culture nml hocml ennfornnty. Ibological 
mental development tells only part of tlu* slory, and piognoHca made 
on this basis alone arc subject to a very large, piobable euor, largo 
enough even to invalidate tlio prognuHCS 

True prognosis must begin willi acouinH‘ diagnoHiH, with leaped 
to Fundamental Abilities and domiilox Mmilal FroccHaen, and must 
Infer development in accordance with tlm curvoa, T'lm fumlamontal 
endowment of the individual Is basic, to be huh*, but lim ultimate value 
as a unit of society, is even more determined by the permutations and 
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corfibinatioiiH of iMiJuluuK'nlul Abihlk“<, i.c, the development of his 
Complex M(‘ntal I’rocei'M-h 

The following conpluHions are nuhrtiled* 

1. Mental Heliavior, an an index of mental growth at the College- 
Adult Level, should he umdy/ed inlo Fundnmcnlul Abilities and 
Complex Menial Proeesses 

2. 'J'lie devi'lopiiu'iit of Kuiidameiitul Ability, regarded as a bio¬ 
logical function, Imshol yet reached Die plateau Hlago boUvocii eighteen 
and tweiUy-three- years. 

3. Complex Mental Procen.^es are more largely duo to environ¬ 
mental prcfwiirrH limn are Kuinlainental Abilitie.s, honco they respond 
and increase more rapidly at the (’nllegc-AdulL Level. 

4. Though wo may not expect (he Complex* Afeiital Processes to 
increase indefinitely, there is no evidence of an approaching plateau 
at age twcnty-tiiree 

5. Fundanu'iilal AbilUies develop as much, or more, in any single 
year between sovmi and fourteen, as llu'y do during the entire five year 
period from ciglUeeii through twenly-two, at the Collogc-Adult Level 

C. There ih a possibility llml the prolmble proportionate inorcase 
of C'omplox Mi’iiltd JToeess develojiment, and tlie proportionate 
decreaflo of Fundanuuilul Ability development, just prior to or about 
the age of puberty, may purlfuliy ucuount for Che changes in mental 
behavior observable at tlim period. 

7. While eluldnm up to eh-veii years of ago may ho more Inevitably 
committed to reaclioiiH at the level of inological mental development, 
they become incieasingly eonuniUed to reactions at the higher complex 
intellectiml level tliereafter 

8. Predictions of belmvior should bo based upon the shape of the 
mental growDi and belmvior curves, whicli change conspicuously with 
increasing years 

I wish to expri'ss my gialitutle to Dr George Gailcy Chambers 
and Dr. II. M Lufkin, of the Depaitmont of Mathomatics, of the 
University of Pennsylvania, for criticism and suggestions m the devel¬ 
opment of statistical jiroceduieH; to Dr Samuel W. Feinbciger of the 
Department of Psyoliology of the Uinveisily of Pennsylvania for 
council and UNsIslance in my inveHligation, lo Dr, Ilobort A. BioLe- 
marlcle, under whose siipei vision tlie investigation was earned out, 
for materials and HUgge.stioiis which greatly facilitated the woik, 
and Lo tlie instructors and studeuls, whose cooiierntion ovci a period 
of thico years made the materials available 
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ThonKhk<', E !j,' MMi.«nn‘»wilU InHlvRrji**.' *’ 

Thuralonp, I/iL/ A MrltirMtof KF’iilmKl’fi\rtiMir»RrBrriBtia Juurnnlv/ 

P»y<hoioQ\/, Vol. XYI, N«i. 7. AKmlul^* '/riM in IntPlliRnirp MraBUrcniftit 
Payiho{og\<6iU Rm^u', Vftl XXXV, N%» .1 T)i** Mpmul ISrowlh (linvp loi 
Bind Tcalfl JouphaI o//ff/uM/iftHal/'4yrft*‘I'»?7, Vul XX, Xii K 
Tillorii J. ^Y ; “11m llriRiion Iirlwfcii Aiwk'ihImiii m«l Oic HirIht Menial 1‘roc 
Oteci." Tc'iichere CnlR‘f^p iMUhrallont, t!.*lini»liin Ilnveroih. HrJO. 



A MODIFIC’-A'l'ION OF 'HIK (X)^IinjTATI()N OF 0 
MUt/riPr.lC (’OTUIKLATION AND lUCCDlESSION 
COKFFiriKXTS HY T/IE TOLLEY AND 
E/J‘UaKI, METHOD 


THE 


AARON HAKST 


’lVnf'lu‘r»» CViludiiim Onivoraity 


The Tolley oixi l'>('kiel rnotloxl of Im/Klling the niultiplo corre- 
laUon problem kiv<‘jj m Ihcir papor* iiiul furllmr mothriccl by Gnr- 
lett® etuloH llu! roluUoa lrt*l\^ceii the pnrlml rogro'sHion cooITicionLS; 
b's, ir\ the form of w w‘( of linear imrnml cejuationH that can be solved 
simultancouHly. 

These equations are given in two forma: eilhor in tcims of the mean 
product HUiiiH, or in the terms of the oorrelalion coefilcients defined 
by llm relulionH; 


7ht ~ riicriffs, ru 


-Oil's), 

‘AVjtf, 




"A 


llewnting Ourrelt'K eqnuliona (;t) (p. 42) we have: 


fn '> I ii’iii (I 
Til * ' I ln‘'ii it 
rn « fit Ill'll. II 


fj» r». \}i'in II 


I 'II f Il'lM II 
« M 

I *1 


I rii I ii^M It 
I ft! IiihiiIt 
I iiil>i(ii 


1 ' I rih.Ullllq II 

I { rtt.Uibin II 

I ‘ I ruiltilim II 


i 'It !»»'/»/ !■« 


i fit tub'll II 


I • • • f* l»ibi» u . 


wlicre the values of /iji, Am, vUi, etc me repiesoiUed by o-a/o-i, 
Oi/ax, etc., n'Hpeolively 


‘ Tollcyi Ih R find Krvktflt Af .t P ' A ftletiKKi of JIn/«J!nig Mtiltipio Corro- 
liktion I’rottlniiH JnuniMt <»/ .Irocfiron .SfiiO'-Ocrtt Vol XVIII, Deo , 

1023, pp im-inii,). 

»tJurretl, iti-iiiy K , A .Moiinirndoii of ToHcy and K/pkit*l'H Method of Ilnod- 
hiiH Mulliiili' (’orrk’lntion I’rolileiiiH Jininnit o/ PHycholoyy, Vol. 

xrx, Jikii., IU 2 S, pp !r> tn 
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I'hf •'f / ^'ilK ]* 


m) 


TIu' Vfiluf «(f ?'u «i f ^ 'Arin^‘« i» ^ rjnniJiiU'il f»inn twj 


' -? « 

5 ,»-i ti • 


1 

y »i» 

^ -J.l 

K r 

-1.. 

5 »..d • 


I 

I 


fjo ^ • 

1-1 y.' 


. K ., ' 

-tn 

- U . 

1 < 4 n 



. 1 -. 

> .1 i 15 

In'i Hi; 


» ,4 . 

4 „ 

i 


*”.-,.1 '5 

><-1 jj 

J 

1 

.•l„ 1 


Thv. colunujw ui \m\\k M Ui»* uinl dctor- 

mumtnr htivc o(umu<iu farton* .1 .j, .In, 
outfiidc of tlu* (Ir-irrtnifmiii Nfnn'nvtr. lii** farforn nf I In- tlctonni- 
imiilr of Iho imiiicnitor «iipnir a** fufi*»rh in fli«' •!» [•■rnimani of llic 
clcnominnlor. 


ThonTofo, ih«* valm* 

of htj 

'4 •. 

ran In 


V;, 

> .i 

1..’ 

1 

15 

1 

* 4 

1 1*1 

i 

l< 


I 

> !■> 

1 

1 

1, 

^ In 

ran 

«'|.i • 

1 

. 1 

On 3i n ■- ~ 

1 


* iS 

riii' 

An 


1 


. . 1 :k 


rj* 

»'55 

1 . 

> M| 

■ 


1 Sh 

1 Sn 


. 1 


In general the value of feuaj, „ oaii l)i‘ e\i)n'f-‘^cii in LIiih form, 
and noticing that in the delcrminanl of Uic nuniorator wi* loplace witli 
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tho coUiaiii rii, rp, ru, etc. tlio column m which tho coenicicuts of 
b\k.ii . n iippcar, iiiul ffiorc'ovor that troiiHpoHing the ^th column 
in tlio po^'itioii of lli(‘ first column mid tho A>tli row in tlio pomtiou of 
tho first row of IxUh di'tomnniints wo do now cliango tho value of 
b\k72 n nod (hon roplaco tho k-lh column lu tho numomtor in tho 
Biuno niJiiDH'r an in cast* of ohlamiiiK the oxprowaon of bans « tlio 
exproHaion of hur „ h aa folloWH; 



fltt 

/alt 

rn . . 

. /‘In 


Mi 

1 

raa . . 

. ru 


»n 

/« 

1 . . 

• rzn 


^ in 

Tan 

Mb ■ 

1 

Jl •— 

i 

rai 

ru . . 

* ^/n 



1 

/31 . . 

. ran 


1 

Ml 

1 . . 

• / 3 h 



/ 8b 

ran . 

. 1 


'L'lio ovalualion of thosi* two <lo(orminnnlSj which aio identical, 
with tho oxcoplion of ihoir firnt coItimiiH nan bo done ns follows: 
CoiiHidor a dotoinnnimt 


«1 

h. 


d. . 

. Li 

h 

«i 

b-i 


dz . 

. ila 

h 


b^ 

i 1 

d, 

. ^3 

u 

Or* 

K 

Cm 

d„ . . 

k„ 

L 


Multiplying oacl) loim of ovory cohiinn l)y tho first tonn of tlio 
colmnn rm tho light, with ilaHign changed, and adding to it the prod¬ 
uct of Iho oorrospondnig loimH m tho flame low in the column on the- 
right witli tho first teini of tlio origmfll column, we have: 



The Jounml pf I'ilueaiwnnl Pf^ythttbigy 


' ■ W> w 


0 

fj 



a^i \ 


i 

■ tjfj *}'i^iii (j 


f'/i 

i ^,c* 

■‘t'lh 4 1, 

*-•0,^1 d|6« 


1 ^1^ 

"'’tn/l '1 til, 


and Lhi« by ihc nl iht* tlcl^'rnnimnt hy iiniit)rrt (InkiiiR thom 

along lh(i row) is triiThfrirmnl mlo: 


{«!)» ifriciili 


t fliS 
' hiAi i «i!)i 


ftili/J w D* 


(KJ * fiM 
ti*fi < fiKi 


i iilj 
Jii^i j ^ilt 


—«iAi * 4K *=%?! t • ' Ml } 


or finally 


1 ) ^ 


KCifii 


dvfci' 





njit 

iWi 

1' 




jltifi 










i.[ 


(i) 


(iihi 

li\Ct\ jri(/i 

. . 'U\ 

n„f»» 

fWni |rsd»i 

\u. 


Ufling this transforinnlion, iiiul noticing lliat tin* IcrniH tiikcii out 
in tho fraoUon on tho left of the dnlernniiunl^ [A) will l)i* t'liunl for 
both determinants of (2) the pxjiro^'mui for tuaj „ oiui be 
rewritten aa follows: 
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i jr^^rsfc 

^4^ra^ 

i 

lrs3 

rn^2i, 

I l^nraj 

1 


i 


1 rrt 

Wji, 

! 

1 ''as 

' 1 r« 

1 

• nrsjt 


I 93 I 


I 


1 

I 


Continuing (ho |)ro(’o>s^ nf (ratisforming i!ip dotorininanls m the same 
mannor the coniph'to ovuiuution of thcAutss. n ih concluded. 

The adviintiiRo of iIiIh loolhod of ovuluulum lies iii the fact that in 
the ca«c of oaoh imrluininr rogifKHum oocflietont only one column is 
inBerU'd in iv now pomllon in (In* iloloiimnanl, and only one row and 
column arc tniuHixiHcd in (li<‘ floiorimnuuls of (lie nuinorator and 
denominator 'I'liercfore, llw ovuUmlion of any Hubsequont regression 
cooincientH m hiniphlic*!, foi as il jh acmi from the natiuc of detormi- 
imnt (A) ccrliun reHuliH an* rolameil Ihioughout the onliio process of 
computing, 

It can 1)0 r(*adi)y msui dial (hia process of computing offers anotlior 
ndvautnge, namely (hal any regroMwon coc'irieionts of ordois less than 
can be obtained diirinf? the coniputnlion of bu n n. 

Let us \vnl(‘ down the M'l of eciualioiw predicting 1 ju.23 

I'la A2dna,*i "b rajAaihuofc + Hk^kibiku 
ha *=" ra^Asjhis-a f-/l.nfti39) + 23 

hir '■ H* rsi/laifinsu 4- Am1>i;.23 

Tlic rentier can leenlily eaiiHtnict the valuo of 6n-33 in the foiin of 
dotormiimiits, it is (following the fiuieess deHCiilied above and trans¬ 
posing rowH and eohiMiiiH) 
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rife Tih rsfc 

rij lr23 

- rn rss 1 

C-ii as i . ■ 

fffc Irjfe rsfc 

rjfc Irja 

rat Tn 1 

It may bo observed tliafc when solving the original equations for 
&U 23 n the values of bik.a, but 23 , hifcaso etc., may bo computed. 

The formula for the coefficient of multiple corrolatiou, R, as given 
by Garrett (p. 48, formula 7) is 

bull .iru<r» + l"Mi 1- ■ I-bi« ii • • (n - 

--g-- 


substituting m this formula the values of bn 2 s . n from formula (2) 
WQ have 

IB®i<as...n) = 1)12,34...nri2Aai + 1)18.24.. nria/tai-h ■ ■ ■ -j- 

l)ln23 .. (r»“ 1)1 In/lnl 


or in other form 
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• r 3n 
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(‘itnrhtf.un CofftmUs 

which Agmii f'uM'H llii' ,4 aJl i],,. 

“n" ftfl well * 

Siinilflrly, Ojih (hr rjiIcnlfKimi t)f (h,, Hliimliird morn 

of estimate of iilt (irderH up i*i aiul ^iye.!\ |,y dm 

formula 

ff’Mj - ^,\/t /^Vn „) 

•riifi mw fiful II|*‘ kIu^- r„ ^piK'.irn iuMhI, fllri-'l.i'ii mil- in hod, 

dclcnmnjmts. Tlif’winif-ajipliM r*i t'*]. 



the effect of the 0^^ iWi « NOllMAL CHEVE 
SYSTEM ON FAIEHUKS ANT) GllADl-; VATAJES 

J. DK W!'1T DAVIH 
Vtii\cn»»ly nf 


Thcrfi appeared recently a bluily* H'tliiiR up tin* fi 22 11 22-0 per 
cent procedure for a five \h}\uI arlifini' It Iuih disliuct 

theoretic advauliiK<‘ thow* rcconiiiinulcd hy otlu-rn, iiinong them 
Dearborn* ond Uu«k ’ Any u«* of tin* nnrnud (Mirv(' jih n biuiis for 
grade difitribution oroiiscR botli alnmg oppo'^iMnn j>!ir(irulnrly from 
those who do not know how to apply il, and cMpmlly nlrmig support 
from those who have* given it the mOKl slmly ntnl rno^'l enreful applica¬ 
tion. The growing employment of one nr uimlher nnnhitciidon of it 
prompla tliia analytical study. 

The purpose here is not to show how <'iUier <)ie siimll ni largo class 
ns such is nffecled. The task awimied m iwofohl, imniely: 

1. Aside fiom other factora of lesl validity, ami reliability, and 
also nsidefiom other ciuiwr for leiiviiiKaehnol, ami ii'^nle fioin enlraiicea 
other than as a frcfihinan, whul ia Ihe elTeef of n ^l riel nppheiilion of the 
6-22-44-22-0 Bysloin na a bania for collejci' grades from (lie Hlandpoint 
of collogo failure? 

2. And further, wlml vr tlm comjuualive vuhu* oj reUdivi* worth of 
grades from class to clnaa when lliia Hyaleiii is applied? 

For convenient thinking let uh assume that after the wi'eding out of 
Freshman Week there reinam ft group of one Uiousand stmlenls for 
college work in a course which conliuueH foii.smailivi'ly tliroughout 
the four college years with three leiina in each yeiii. No others 
join this purely hypothetical group, none leave it exci'pl by graduation 
fls seniors, or becauso of being fmled by lln‘ wyHlmn. IIow many 
survive at the vaiious levels? 

Tho adopted sysLem requires a brief explanation. By naUnc it 
forces cnoh new tciin group into ii nonmd diHlrilmhon. U automali- 


'DoIIh, Walter Crosby: An tmpruvoinenl ii« ihc Tln'iin-tic-id biiHh of Ihn Vivo 
Point Grading Bystom Baaed on tho Nonna] I'rnliiibililj flurve Journal of 
Educational Psyclwlogy, Vol. XXI, No. 2, Pcli„ Ifi'JO, pp. 12B lItU 

* Dearborn, W. F.: Soliool and Univoraity (irailcH Univirhily of II’incuhsih 
BitWeiin, No 308, Madieon, WisconBin, 1010. 

*Ilugg, Harold 0.: “Statistical MoihocU Applunl to Kducation " IIouKliton 
Mifflin Co., Boston, 1917, pp 210-210 
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ca))y fails six per cimU, giv«*H fwcnly-l«o per W'nl a Knulc- of IV, 
forly-four per c(*nt a of HI, Iwrnly-two iM‘r ornt a giado of II 
and six per coiit a grade of 1. Snire the grtiup ik forced nilo ooriiialcy 
it may be fiHHUined that (imetirrillv one Juiridred per ecnt ifl inoluded 
within ±3ir range. AI tlieii lirgiim al. up)>roxiinal.t*ly 1 6<r and lakes 
the balance up; Alt beftniH al a -I-.IV and exlenda up lo the fonner; 
AIII begiUM at a I'xy aiol Knea up to the jowesl II; AIV bc'gina at a 
-l.Off and eNtenda to (he havoM IH; while AV (akea the hnlauoe, 
-l.Oo- down. 

A table conHlnicled on the biiHa of llna ayalem ahowH clearly the 
elimination (hut (aken place eaeli of the twelve school terms when there 
are three lenoH (ler yi’ur for four yeara. 


■J'AittE or FAiM'fiRK mi Hckooi, Teom 
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ability inpoinoj^ivcn linrs iiiijiliralionsurouBcd by the 

pincUce and thfn'fon’ arc «»iily pnn nlliidic'a! tn Hii> (|m>shon. 

U’he table uijovp i\UHP.cm tlir (irpt f|nory, Jiami'ly, a atnet npphciilion 
of the 0-22-4*1 22-0 plari gradually rliinlimfeH by fiiilmK a total fifty, 
one per coni of the admitted fre'ibinen, nixly a1 tin' hrnl term level and 
thirty at the ln«t term of wmmr •work. 





As to grades, what is thoir relative value from term to toini, when 
assigned in this manner? By the use Uie geomotrio jiiogrcasiou 
formula^ the nomograph following was conBlructod Since the upper 
end of tho diBlribution was not nffoeted by failure the left or lower 
end was sbortoned. The border lines of tlie guide spreadH as given 
above were determined by the ueo of Hokmgc'r'rt 'L'nldoH.'-' Notice 

* t„ a* ar''"' when I »» the term wniiled, « Iho nunibi'r of the lonn iri tho Hories, 
o tho first term of tho sorics, and r Iho ratio. 

’Hohmgor, Karl J.s “Statistical Tahloa for HHuIoiMh in KduPiUion and Pey 
ohology “ Tho Univoreity of Chicago Prcaa, 1920. 



The « 22 I't 22 n Knriwl Curvr OliO 

on the nomogrnpli llmt Jhf ini*an ni rtiHi lovH, l)y conforming to the 
normal diBlnlmliun ih cmiM'il lo imgrale to the riglif flunng the Iwolvo 
terms a total dmluncc nf 1 inj on the nngmiil huw lino. It i« from this 
now mean alwiiyH llml the liv'd tliMrihiitiou w inndo cnch lorm. /V brief 
study of the grnpli ninkoK tin* roMiltK (•vnU'Di 

A table of coniimroil grmhn for the four cln‘>WH t\.s pictured by tliis 
graph will be huflirient. 


Kiiiht 'Ikiiw or Kaoii Yrau 
('oitUMtroiOh of (hndc VrIuw? 


P/cshiJiDn 

Rojdiomorfrt | 

JunioiK 1 

1 Seniors 

gradta 

wmivftlnilfl 1 

e«nnviit(‘nl0 j 

J crjmvnIcnUi 

I ! 

All of Ir I 

i 

All of Ih 


Upivcr Ilfl i 

Mont of llfl 

All of IlH 


1 

1 


A few life 

11 

Ixiwer Ilfl 

J.<)wer of llfl 

Polance of Ills 


Ahouvoin^haU of IIIb ] 

1 

Xi'Arly nil of HTh 

Over one-hnlf of IVe 

III 

Ilnlnui'*' of IMh 

Bnlniee of IIIh 

Ilnlancu uf IVs 


M0Ht<lflVR 

1 

Ail of {Vn 1 

(K'«*r <»ne»h«lf of Vs | 

All of Vs 

IV 

HnlfUiri' of IVh 1 

Most of Vh j 

Etninnro of Vh ^ 


V 1 

balain'i' (tf Vfl j 

1 



Similar tablea of compnrihoii run bo worked out by Iho interested 
reader using the gnule rif uny other level na n criterion. It is evident 
that the farther removed from (uich olliei by bchool terms the grades 
may be tlic Ic.'ts conipurulile they become. 

(JONCI/UBION 

1. A strict npplioiUion of the 0-22'‘t'l -22-0 noimnl curve procedure 
as a basis for grades m n twelve leim course would eliminate prac¬ 
tically fifty-one pi-r eenl of the matriculated groui). 

2. This strict practice changeH Iho values of grades from term 
to term so tiiat a giudo of I or II, etc. Iina little directly comparable 
moaning unless associated with n particular term level 










MO fhf hml f/ PftifUinn 


Mudi liiwi Iwn vinlldi nlwni iircdiPiitiK pIcH (niiii thoKinjjj 
111 (ormer ftfirk. tlimsliKly IIikhkIi i 1 ii< iiimiirpu^^nij 

wuiTied to III’ iH’rfi'flly viilul nml ri'hlilc, lliol fircilirliiliiliiy would 
yet l)p loiv due to Him W of rtuiiiwululily cfeiidly id wlien ((fm 
Krndcii of W’liiiini me |)fi‘diei‘’d wy friiiii fh'uliiiiiiii or miiilioniore 
Krades, Ihderii iiiiiy depin' ftimllu'r ‘•yuk'in Id iimvide for uppnteoi 
sbMmi, al llii'Niitie liiiu' toiinidny llm lumie liTliiiuiiiiMif llii'uoriual 
ciirwi and yet to h’li tin* iidiii' nf ph o(|iiiil Iml ilml, in 110011® 
Nliidy, Olliers will rerull lliiwd-lli’il i' 4 t ivliiidi riill bs ilm i^o 
scincstfir year division and will nl «iiit elorl roiii|iiiriwiriii willi tlu 
twelve term bcIkioIs, .tliiiiy micli iinpliniliiiim iirmi* railing (or fiirllict 
coQsideratiOD, 
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THE iiofJTixj': irnmnwrioN ov vahtim. and 

iMUETIPfJC COllUKUTION 

lUYMONIl I'KAKZKN^ AXO MAHMW l)EiaiYHEUllY 
Ainrru'fiiJ (liilil Ili'nltli AKMK'mdou, Now York City 

Prob/il>ly llic >*nii|)]pHl hdiI iiiohl direct niPt)iod of cojnpuUog 
multiple corrcliUum luul llui rpgrchHUHi ropfllcipiUs of a inulliplc 
regression oqimti<m iu llu* foriuulHm of a Hy8lci!\ of normiil equations 
from the luoineulM und proiluH tnoineiUa uixl the solution of these 
C((iift(loim hy (ho Doolildc niolhod «« r<'i«u*t(‘d iiy Tolley nnd E7,ckiel 
m Vol, XVIII of till' Juurml of ihv /Iwunron »S7nIi8/icfd Association, 
A modified form of liiiH niellmd to In- uiinl \vlu'ji tlie lutcrcorrolationB 
arc known ami tlie raw imuneiilH un* not uMulablo was published by 
Clnrrctt.* It often Imppium, however, (Imt not only are the regression 
cociTicientH and the mnlttple eniri’lulton desiKa), but the partial 
coirelatioriH are neeiled f<>r nil^uprelulive jairpuhert. In such probleniB 
it is moie lulvaiitageouN to eompnle Ihe inuIliplc! conelation from tho 
pnrlml coircIatxinH aeeoi<iing to the usual forjuuln: 

/It n« • M y'l (I r Mill r’lMid • r’H lO n i) 

and the regrei-sion eoedk'ieiilH fioin (he fornuila: 

in 31 fi “ 

1*13 n ' ^'13 31(1 _ ~ ^3 _» -*) 

VaVU ~r'33i)(l 0 “ u h-i) 

But llio eo/n{/nla(nai of t.„iM « » «nd tho other higher oidor 
pnrtials l«'eoni(‘s meieasmglv lahonoun as the nuinhov of secondary 
Rubscnply aie iiieieased U enii he shown Dial, llie formula 

_ a d- 2(a - 1) d- :Kh 2) d- • • n(» - u - 1) (1) 

* A Minlillculuin of 'rtilli-y tiitd Ej^ekiel'M Methoil tif llaiidlmK MulUplo Cone- 
lation rrobluiiiH dynrnij| of Psychology, January, 1028 

G<11 




njo 7/,^' Iff !*' J.hih,fiy 

^ivr'< thf inihitimio ^ J.M 'in m f«ir rninputing 

n piirhiil of tlii‘ f/ili or*5''i. or, m nM*"! ■, i) tlii- minimum 

llUIlllrtT of (lllJf K KIm' ll‘'U j 1 foflljUl'l 

'’17 ''u 

* ’7 s , , , 

^ i * ji\' 1 r j, 

imihL ln’ h|>p!h il fo lionlb* *’** •* “f Os* aiOi t^rdcr. It will be 

iioM'd tlinl foimiil's Oi Oi** vnfjiv.im mmilrrr of coinputntionB 
Thr powilil<‘ uhiiiImt t!oi> m*»> MMiiimPd nmiiy mon' than that 
Rivm Ity fnrimilu U) I'*’*" 1 m ♦ loh]"'!!*' » foviitli ohIit partial 

It is poKHil'Ii' to rouipiit?' OisrO. <i\o t'-p’jri*-*- I'lsrlmN Isfora fiimllv 
oblninmp u fourlli onl'r pariril. Iiii rI,o oOii-r limiil, only twenty 
piiiluilH iir*i'<l 111 * rtuopittf‘1 if Ou* ino’’'' »rnjjuijin ril ccsMil'inalions oi 
coricliiliiins nri* mml** lU On* rMinnulnlioH nf On* lowii »nfliT coefli* 
eirnla K\rn thiingh On* n»in|ml,n»**ii** 'iro lo’olo ni mjOi a way tliat 
th(* minimum lujinhi’r of immolsjin* < ompiit* <1, ih*‘ UMinl iiifilKui still 
ciH^uirvs ennsuleiivUU' wlluklion to uvowl m\\ ('omlmiulion ii\ 

one of till' lower order jMirh!!!** wlneli ^\o»i)»l lo'ilv'* oil tin* snlisciiuont 
work erronciiuH 

The jjielhnd hen* pre'ttiiletl riiinpU t'dv *'liMim'ite‘. ihit-e ihllirultlri 
hy rt'diiciuft llie Holulhut to iMeeleiiurol niiilim* li elinms (lie follow- 
[n% advuulaftesi 

1. The nth order piiOutI eorrelntitm m idiiaiiiid m the luinimum 
luimher of operalioiiH, «uu!s* tlii* )Mn‘-iliility of iluplieiiiimi of einuputa- 
lioim )H olunitmled. 

2 Coned oomhmiilmns of bivwr order pin hols no' ronlniely inndo 
usftunnp; lUe. nccunvU* hifthor pwrOnl 

3. All compiilatums itr<* uiiloiirideullv <'lit'i<K(‘<l willioni a double 
computation as is often ndviM-d 

4 Uopoated wrilinj? of (iKiiien is elnnumteil 

6 Bpcauso of the. dm’el ineolianirai ami Msleiimtie euleulalion nil 
tho compuUvUowB from fin<t onler eoirelaiwuiH lo the uniltiple ran lie 
done by a clerk. 

6. A compact, concise reemil of the efun|nil:i(ioiis is ptovided for 
niini^ so that all parliids of a i^iveii oidei and deiioiiiinulion an' kept 
on tlio flame pap;o. 

7. Tho vuulUple eonelnlinn w nbliuned fimn the pavliai foiinH 
a minimum amount of coinpulalinii. 

Tho explanation below may beein dillienll ami I’omplieuled, hut 
the routine is simple and easily folUmed oiute llie mi'lhoil is under- 
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*'/ V»yrh<ihHjy 

t*lmi(K Thr- rnjiipuMlir'U'4 f‘*rm «jOi 0.*‘ HiJru** niul rhrrksiii terms 
oJ 1*^ Iu.4VT5»uj t ll* It Ui' m|w r{i*H>uH ufCf'H®{\ryt<) 

ctimimtc n t "f hrf< t»r<^ r piirOnK from ?S<«‘ it«t'’rr<'hni(uinhii) of five 
vririftlilrHi nn* imSn'iJi* 4 1 *r*vr?^Jn H Utt- mrlhoil (jf irAnj, 

forrinR theH- 1)T''« '>ril‘’r p4r»r«Ui<> a wn*nii f«*r»a (nr SW vujiipulnlion 
of p-rpourl onI‘T piriiHU 

To innkf till* <!ioKriuiJ'< uioro rfirarrl** tlo* iMnIdjilM rorrclalion of 
four iKmy mr'H'-un'mi'ntft «iih wvjulit hiuI rjj^ro'-Mon rociricums 
liavf* liccu coinimtoil from llu' lalilr of iui*’rt'itrr<‘liLiirin‘< mvon below, 
and oucli t>U'|) in tin- roiuiuHsitu'U eNjil'tiiU'd 'J lu- um* of DiagramsI 
ami II wilb tin* will n‘»liir«» tho #>*•» loing roinph'Mty of the 

doladed diuiftionn that NImw. 


Tablb I -or AsTMM<o<mnTiso is O.sb 'I'iiol'aavb 
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• ^Aln gallionsl in ruionviiMii wiOi ibi» S’IuhiJ Hi .iltli Sliol.'. i imibn’l(‘<l iiy Iho 
AmericHTi Child ircnllh Ah^oriniinii hIm ti< (liia rttuiliin lAnH ii»\Misl mid iiHrd, 


Stki'm in 'nii-i (N)Mi»u'urutN 

L To coinpulo lirRl ortkT piirliulH tin* r'H an* l•ol<‘r(*(l on Rprcially 
ruled filicels (rco Diagram Ul) jw**'! »h tUoy would In* cutered ui an 
intor-r table willi tlio exeeplioii llml four Ijui'h nr<* left below nieli r for 
the entry of computalumal liKureH Tlu'ordi'r in u liieli (lie cocfikicnt^ 
arc entered dctctndiwH the order iw whieh llii' viirmidvH will he par- 
tmllcd out, and bufoio boginniiii; coiiiputatwiii (bis ordi*] niost be 
deckled upon so that tin* r'a will be wo ari'anginl on tin* Hbeot, as to lake 
care of tliifl demand. The i‘ori(*liilirmN of nil otluo traits with the 
variable to bo parllalled out 1 iih( me oiiloriul as Ibi* Insl, low of oiler' 
conolatioiis, the ciin(*lalimiH of all olln-r IrailH wilb lln* viuinbh' to be 
paHiallcd out second ih placed wcoiid ham Ibi* boltnin, ole. 'Hmsin 
this computation we liavo elioaen to piiHmi out lop wolili fioio nil llic 
remaining inter-?'s firat and chest hreiuUh wh'OikI. ((Nooimre 'J'nldc 1 
and Diagram III noticing nrrangoincnt of vmiables.) 



CojnpvMwn 0} -i.W MuU>,ih r„a,M:„u t.iri 

r lu.law viwh nf <ln' r*»m‘lsttiojj?» in Hii* U^i Im*' ‘^'0 

. w ^TrrLlio fn (Uh' Hirrrlnlu.n« uill. ll»' vniiM*!.' In l.c 
of mtcrcorri Uil ^ Hi'l‘nftrinK 

iS'rm. ■" v. -.. 

Si™ of Vl ' .. ' - ■■"' '->■ 

Hi* 


HclRllt 


CliMt Df'pl^' 


CKcat IJrcftiUlt 


S’iOl 


Hip WkUIi 
K 


I 

^\ cirIiI 

(1) VM'JH 

( 2 ) 

(3) 

(4) 

(fi) 

( 0 ) 

(7) 

( 3 ) 

(9) 

(lOj 
(lU 
( 12 ) 

,(13) ‘ 

.(Uf 
,ae) 

,( 10 ) 

(17) 

,(18) 

(iV) 

( 20 ) 

( 21 ) 

,( 22 ) 

(23) 


n 

llfiKhl 


k:);i7 


H7fi2 

-lS37«i 


2 


am 

lU 



Clu-st Jli'plli 


n^im 

OHIO 




IV 

- 


Olu'Ht liri'H'llli 

7331 

■ ■ nofio 

7.11*3 

.070707 

718120_ 

080082 

2 


V.PJ.'l 

2 „ 

> 

OHO'M 

1 1080 

0840 


' — - 







♦ To Hiinnlifv Ilf vxulaimtion ii» me icxi. ‘ ‘ 

Tha ar' „at un o.-^ry n. U.o o..Un.ry .... 

The oon.,..uouon« .loHonb.'.! in Slcpn », '1 and r, In'l.m n-,,.,! 
the chock «i d m-o not nocoBHn.y for U.o oon.pul,a.«n nf ho |™ In.lo 
3 H™in..inK ..1 U.n .•xt..Mno ri(!hl of the Inal row „f .nlo,™,,,. ,.- 

uonc (line ui) n.hi 





oto 


7 '^>* *1/ /ifiiiirT" 1 ‘ 4 ^ 


\\\ llu* firt*! f^tuiuu <XJ? \ •'•‘'•'N j' wy^ilnj \n jli. h rn«(l po\u!iin, 
{iml 1 l«7{^ 7.?M1 ’i’kf»s<*'ii i» Oil' 4K»r<l, mii'I *-*» »<n MjwardH Ihclcfi, 

unlll III! nf I hi' ir'« hir*- l-m a‘M' Ihf- r in ilif hi'*! rnluiim to 

llu' h'fl II J" i‘«ii n* M ' jr\ lurhi.h’ fhi" y in i)ji' Miiiiinainin 

'1 'Dif lU'Vt inc' 'Im*' n* Jij4« <t ih«' liiif nf /.'k ilnic 17) 

Iwjtmnmft mhhI-uK v<.i^U lU* l»ynr* 'i» Jit" * \*t< un- tn,'h(, uiid sodding 
1‘jiph Hniin' ui j-nn-* 'I'M'h viiHi Sln*» \t < jiMMU <if »)(«* ^ im l In- cnluinn 
lo tin- h'ff 

fn Suiuniif'lu’nluMiM'»f ln^ r . ^ nnnMiJii? sin* hi -1 hin* nf r'a (lini'10) 
uml ri’f'ord t»n Ini'* '^\ Trir •xjniph', i** iln' Him nf 7128 + 

.m\ *1 Ml. 

(‘oiii[)vitu(iMi» ii ffi n an* illti‘ <1 HM I ha^r.'Uii I \’. 

0. ir 11 OMU'uiulnig iii'tnliuii' I • ii^m! |mt f li**. rliif h in I'niiiinn I nnd 
in llu' Iinttnin nnv i S7.'i‘j m nm iMj iii iln* inar)iini' ninl multiply by 
cnrh Mirri’ciliiiK r III lli[4> r*iw Tin* '’.ritu'ii ln'iinUli racb 

o( ihc uvilt'r rV III enltiuui 1 in ‘-.mi tin* 0110ciUcml 

on linn 2 ik K7.V2 X , OtJss \ itn n <1 nii Inn* 7 umii r (lie ncM zrror 
111 lli(‘ firfil eulmini ih tlif* itr^Mliirl' nf Sin'J >. hDntl ;nitl 111(10 nii lim* 12 
ia .8762 X 7H2;i. 

7, Sinnlarly pul llu* r in I'nlunni II uml lu tli«* Imlloin rm\ (.7331 
in row 16) in ilu* immUinu ami uniUiplv liy nimh r in that 

row and rocord tin* prnihmlH m riitinnn il m Mim *'M»m im hm'H 7 ami 
12. Th(‘onlry in cnluinn IH.hiii* 12, m tin* jiinflnrt nf (In* r m column 
III on the luBt line ((105(1) ninl the r in (‘nliiiiin IV ( 7.12.1) These 
compululioriH rivo Ihi* I'Ufirclf'd Utiii of lln* hvrmuln lii‘ln\\ for ci\ch«( 
the BIX piu'liula on PiuRraui IV. 


8 . Subtract each of thcM* jmiduots <»l>luinvd in Slop 7 from the r 
juBt above it in the column. Tliim, .ICKH) in Inn* .’1 \h 7 'I 2 S - .0119 
(Tlio oppialiona UKlicalcil arc, of (’oiir.M*, iilunys [K'rf<uincd iilRobrai' 
cally, Riving proper regard fni'Bigiix) Tlnx i« tin* niiinernloi of the 
formula given idinve. 

To chock roKult tUuH fur; 

0. Multiply the r in lUi* bntlniu inw nf I'nliimn 1 (line 1(1) by llio 
figure in column II, line U), and enter llie jnmim't 111 cnliiinii !, Inu* 22 
Thus, 18910 ia tlie product nf S7ri2 X 2 HH.'l l.iki'wihi' iiiulliply 
the r ill the lost row of colninn U liy the iignu* in column 111, hue 19, 
and iccord the product \n column U, Une 22; 1 c., (he I 0173 1*1 the 
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product of 7:i'U X I 't'ln rt'imuiiiiiK imKluct m colinnn III, 

line 22, h found m u Miiulnr luaujUT 

10 SuhUuct liu‘ luiuliud*^ tdiluiucd m Ki<‘p 0 froit> llic miniiiialions 
immcdiutcly nliovc iIm in on luu- 21, miuI nitf-r (lie di/Tciciuics in lino 28 

11 Sum Uu' muiuMiitor'- in cnlmnn I on luul 18 oldsuned in 

Step 8. The ‘•uin •’IhmiM riiiml ilio fl^uio f*lif}wn in ('(iliirnii J, Inn* 28, im 
the lesull of Suit in, Or 1(10') ) 2118 1 ,1028- 5050),Of 

course in sotnc in-'*' (lu'io nmy lie a differenee <if 1 or 2 jmintH in Hut 
last deeuiml pliin* iluc to ilrojipiM}; <»f dceHiiiilH In ii Hiinilur iiuinner 
coluinnH H luul III uie elu'ckfd. 

To compute the demninniilnrs; 

12 rci'fomi (he mulliplieations ih senhed in Step 0 uoiuk Uio low of 

Vs, line 17, jns|(*inl of /'s, linn Hi, nnd enler (lie prmluclH on Uu* linos 
below llie sevem! lUUiienUorH olduined in Step 8 TIuh gives Iho 
cloDOniJiintor of I he forinnln nhove, (i r 8'2S!) 1887(11 X .079797) 

To chock ihesp eidru's; 

13 Miilliply Uii' A In eoluiun ! Ity (lie huuuiuition in coliunn II on 
hnc 20 Heooi'd in ediiiinn I, line 2( Sum the denoinnuvlors in 
column I uhlitined fiorn Step 12, linoH I, 9 tirid M Tlie two lesiiUs 
should cheek. Sinniiirly multiply llie A in column II hy the Humiualion 
in column IH nm! (lie prodiiel ^)loul<} etiuitl (he sum of Hie products of 
k'a in coUiuin II 

Fimd compiKtdions' 

H. Divide llie immerntorH oliUuned in Step 8 hy the rcspecUvo 
(Icnomlntitors oldiuneil m S{ep 12, Tlie leKullH are usually written 
in rod (itulicH iiere) or ollu'rwise nmile diHlincLive ho they can bo 
picked out readdy. 'I'his ((uolierit- is llu' partial, Fm example, 
.1009 s- 8280 gives 8()(iS, whieh is the pin lial coneliition of height 
and weight independent of (he innuetieo of width of hips Sniidarly 
.3579 la the udatioii of cheat huaulth lo chest depth independent of 
hip Width The only cheek on this division h the nuiltiplicatioii of 
the (Icnoimniitor liy the (piolient, ohliiimng the numoialor. 

'To compute siumiiuI oulei parlwds. 

15. The ji]s| Older paidals i)l)!ained on Diagram TV aie entcueil as 
.shown in Diagiain V. 'i'he aiiangi'inent is (lie same as Diagiam III 
except Ihat no eiiliies me made on hne 10, nmee all the eorjelationa 

* 'I'liH jiiar 111' hImmvii lo he (nir hv (lie folloa'iiig i‘(pinli()ii 

FiJ “ Tur,.) \ (^n, - riifn) I' (ru - rum) ^ 

rj? ■) r,j 'j- r,, — »id^Qc, -h f'n ■!' i"\i) 



The Jnurnnl r^f 

with hip width lmv(* Ihm'm pfirludli'd nnl Tiit* linn m now cheat 
bmftdlh. Thti'*' i-wlru’w rii<^ (’h«‘cVv« d hv pumiuatu>nn of iho hncccpawc 
coluinriH of DiuRraiii IV siKtrfUiK with lit" niniiiitihonH of ilm corre- 
HponthiiK colnmn of IhoKriHit V. Ih iH-rfonimit? tlm ntinpulftiiong 
dpMnlwil in Sictw 2 Ui 1 Uo- v:irfd»l" v\v > t hu :uUU wdl hr p^rtmUcil 
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• Dingram 

IV 18 like Didgrum III with the n 

'lanimiig i mninitiilnniHroiniilf’ti’d 


out. Tho rofiultB obliiinod from (hcHO (lornpulnlnutH iin* nil U'lnlioii- 
shipsof two of tlio vivnahlon im'Hpnotivo of I up width and clii'nl hiradtli 
Kftch of tho flUCcoBBivo higiu'r order i>nrti{ilH can he ui>i}n'ttcd hy 
ropoaiing tho procena, parlmllmg out one luldilnmnl viuiidilc with 
each icpolltion. 
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('oinpiiluJii'n of U«' ,'»{iihJ Mnr'i nr*!'r jiro pictured 

111 Diufir.iiu \ ’Hi'' Jlurci iifiJiT pu'iiJ ‘-i‘ >*• hIiJ-hh, il in llu* iisiinl 

inunti'’r 'IIh‘ (Innl r |'ir»ul 'fr- i'- immii nt llns flinf;rniti 
nml N'lH In' n-ril l r in Hn* f «iiiipu« i-'iMii *fi ih«> r* h' wni (’ocfTiciciitg 
It iHolit'iinnl fr'im a r» arf » ' >*' ‘■n'nnrl t»r<l« r rorn^lationB 
I'liiK IK al^sMV^ wh‘ii »Ilf Jill- nrilcr n -2 
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Tu coinpnii* Jin* iimUjplj* nirp I 

'J’In* muhiiili' j'Hrri'hitiMii rni'llnM' iii ns'«> l»«' I’Xpn-K^-i <1 uk a function 
of Iho iilicnaliiiii (‘iii‘lhrn »N of fin* pnrti'i! I'orn I'liuui, Hiuh: 

li-x m n 1* ?'• u-i) 

If lln' crifcrniii vanuMr lias Im*ii ii» 4 ‘oliiiiiii I ni tin* oomiuitn- 

tion of lh(* hiKM' 1 'w-.iM' Inyhi r onl* r aW of tli*' / 'k n'«|Uin'fi in the 

above formula Imvi- luifi iNi-rnnm •! rv^pJ /.j.,;? ^ i llul 

fin 31 n 1 luiK lnM-ri ho ill** I'orri'^*!MunhiiK h can 1 m‘([ uickly 

(Iclorminc'd from iMim-r'H Talili In lim illuKiialni' labli' tlic/: of 
.2800 is Ofiyi-lS liy a rnuIli]ilH’iiium of Urn A'h in llm liii-i I’ohinmon 
each HUccrKsivi' Hlmct, unil llii* A. of lln* onli-r [mrlml in cnluma 

I the muUiple k or (Ai tn ») will U* obioimMl 'I’liUH Ai ssn = 
dSHVOl (l)iagriuu IV, Inir 17^ X SMIM7 fUia^taiii V, linu 12) 
X .850175 (I)iiiRrum V, him 7) X P57US {I ui -JSIKl) - ,3102. 
From this product /di 5 , 11 . whiHi, of nuirc'*, is \/1 - A i jir. olitaiiicd 
from Miner’s Tabli'H, In ilusrMunpIe Ui 35*4 0177 

To compute tlie roKreKnon rmdlieirnl 
If we suhslilulc in the tmiUi|di‘ renri'KSHUi eipmtmn 

“ &I 3 S 46 A 3 -f- 5 |) sibA's -f' h\^ iJiA I i* /04 511 V 6 ■" f’ 
for 5ii au) 61 a 34 G, etc. tlie parliul r'.s itiid the [laitiai cr’n lliat are Ihoir 
equivnlents llic ccpialion rediiri"' lo 
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domindahtm of Pmlml tnul Comlation Q6l 

If, in l<‘rins of llic iIIu^lisUivi* pnihli'iii, \u* let A', == woiglit, Xt = 
heiKlit, A'i ^ ciu'sl (Iri)lii, A i - rlu"*! Iirciultli jiiul A't = hip wulLh, 
then It Cfin rourlily Jif ‘ftTii fhul (ill (Ik* imitiul ?‘h iuhI piirtid k'n in the 
first tm» loJJjH fif I'fiunlnm fll) an* faki-ii ran* of by Uip coinpiUnlionfl 
on Dmi'iiiiii IV uinl Dnimm V Itoih HmKrniii IV we ha, ka, 
Ui, nnd fioin Dini^inm V we k''* Aai /.'ai r,, nu. imd rn ais 

In order lo eompiih' llie [nirlmN iirreheury foi lh(‘ f.wo lemmninR 
terms it is iii'Ce^^iiiv to rimko (In* ‘•.um* iiuinbei of emnputationa as 
lliOH* mjide Ml Dmirk'Mmh IV ami V, rovomag llio oidor in wliich the 
varialih's are pail lulled oul, in leiiiiKof the illiiHlrulive problem, partial 
out the vaiiidiles in llio oidei ii< iglil, olirsl ileplh and chest bieadth m 
addition lo llu* order hip ttullh, cJii'vt ineiullli and chest depth as 
illustrated on liie dmgianiH iiroMUiliMl Hucii coinimtatioiivS would 
yield (he part mis refpnied for (lie rmiiJimMg two terms of equation (13). 

In problenm involving iiiim* lluiM 6 vnnables it i.s only noeessniy 
to RO from 7ero oidm* r'*i lo the {/i -- 2) or<ler purtuils one time in 
order to olMiun (he Mnltijde U. If the reRicssion eiiualion is desired 
it 18 nece‘'‘^ary Lo eornjnite four (a — 2) order partiala in the manner 
indicaled uliove and (lien return to (licheeond orderI's, leariangc them 
on the work alieet and (lien eoinpiite other jwirlials of order {n — 2). 
For example, if I he piobleni iri\olveH 7 variables, mid in the first 
compulation Ibe variiibh'H are piulndlefl out in the older 7, 6, 5, 4, 3, 
giving the two parlmls ? n aioii and »n a4»<i7i and if in the second com¬ 
putation the vai lables aie part lulled out m the order 2, 3, d, 6, 6, giving 
the parlialH rrr ao-ifl and rMjfiej, Ihe remaining two parlmls desired 
could he obtainiMl by piiitmlhnK out m the order 2, 3, 7, 6, 4, giving 
ru.imi and r,B Ilul the eonipulalions necessary to partialhng 
2 and 3 out weie doin' in the Kecond coinpulivlion, so a rcarrangomonfc 
of the seqiienoi* on the conipututioniil form of (he second order r's 
is all that IS nee(‘«H(wy for these additional iiigher order r's This 
again reduces I In* uinouni of eonipulnlioii necessaiy. 

Though the i‘\plnmiti<ui nmy hcein long and complex, the routine 
18 very Himple. After it m uinleistood mid has become mechanical 
m opi'raliini, (in' lime wivmg is iippioMimitely one-lmlf of the usual 
method. It cun he exfthiiiied to cIciIch veibnlly mujcIi more eiisdy 
than lias beim possddc mi Ihm wjiilen explanafum 



^ STUDY OF QUKSTIONNAIIU^ TDC'llNIQUD 
l-'RANK K. HnUTTI-EWOUTU 
Yalp Uiiivcmty 

This study shows Unit iimicr ihc conditions ilofinotl bolow Iho 
enclosure oi a Iwcnly-lwo cnnl picco in a innil (lucHtionniurp lirouffhfc 
32.4 per cent moio leplica than the Hunic ^ucslioniituro without tlio 
coin. Six hundicd eight per.son8 receiving the coin leiurned 51.6 per 
cent replies while throe hundred seventy-six not lecoiving the coin 
returned only 19.1 per cent Data nre also presented on the vAloof 
seleotivo fnciois and on relative costs. 

Tho study is a liy-product of ivu eviiUialion of the Cattaraugus 
County Health Domoiistiation in wc.sLein New York. L'oi u pciiod of 
Ecvcn years Lh& Milbauk Mcmoml Fund iinancod im intensive 
domonatration of rural public health work in Cattaraugus County. 
In tho spring of 1930 a staff of cxpcila under the dueotion of Professor 
C-B. A. Winslow* undertook to cvaluuto that work. The author 
assisted in a survey of tho educational uapccla of tlio doinonstratlon 
among school children and adults. Willi Home rchictanco a question¬ 
naire by mail was used to assay tlio attitudes of adults cspooially 
toward the financial support of public health work. One of our chief 
doubts about tho questlonimiro was the feni’ of an iiuulcquaLo propor¬ 
tion of replies. To solve this diflicuUy, it was decided to enclose a 
twenty-five cent piece secured in a com mailing caul with each ques¬ 
tionnaire. Evaluation of the results required a control county and for 
this purpose, Steuben, the county just cast but one from CJattaraiigus, 
was selected. The inquiry to these counties consisted of a short 
personal letter each of which was separately typed ond obviously so, 
the questionnaire proper containing six questions, a Btiimped and 
addressed envelope, and the coin. 

The investment involved and the novelty of the proccduvo naturally 
led to an attempt to test tho effect of the com. Accordingly, tho 
inquiry was duplicated in all respects save only two sonLoncos in the 
personal letter and the presence of the coin. TJiis inquiry was sent to 
peisons in the six Now York counties immediately surrouiuling 
Cattaraugus and Steuben. 

Tho personal loiter which accompanied the com wns as follows: 


^Winslow, C-B A., "Health on the Farm and in tho Villngo" Macmillan, 1031. 
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A Study 0/ QurifCummitrc Terhniqun 

A rcspotiHililc orpanisnliMu hft« iinkrd mp- fin an itnimrlial oviUtitler lo make n 
survey of oitnuon (owarcl ptiWiR hfnli)i u«rk ih Iho v,cMcri\ co»inlirJ! of New 
York Slnlo. Tlicy iiro anxionH lo huvo 1(H) por roiil rojihew to tlm (jupfitionB find 
ficcoriliiiKly jiiovidpd funds whirh inniii* imh-ddc' llif rriclostul coin Ib is 
not m pnymonl for vonr tnmM»* m niiHniriiiK llw qurHlioiiH hut rutlior a Hinull 
token of fipprepiHtioii of sour I'ofiinTalion. 

The Ictlcr not nccompjinifil by u coin Hulwlituliul tho following for 
the Inst two KontcncoH m the uIhivc Irllcr: 

The rcHiillmif hiu'Ii a hiirsoy svill iic iruMnl (o the ovtout llial every one nonpei* 
ates m nriHwmiiK the c'lii’loatd iiiicsliiiiiii 1 wiU hv umlofnl if you will inilicnto 
your Qiuiiian au<l wvid il Ut tar* m iho pciehml «lAtn[icd and 

nddrewd ensi‘!o|H* 

Those IcLtcrH svero wuKcn on llio Blalioncry of the Dcpaitment of 
Kducalion of Yale Umviucify. 

The coini)ai'ai)ihly of lIio t.wo arciw lo which ihcRO inquiries were 
sent is of iinporlaiicc in cvalufUing tin* influence of the com. In con¬ 
nection with tli(! hcallli Rlinly, \\Iiicli was HPurching foi differences 
between (‘allaraumis anil S(cnhi*ii, all uvuilablo population, economic, 
and cducafional Hlalialica wcic o\aiiiino{( On tlurty-aevon basic 
factors lliolwi) connticH proved lo lie very much alike. (JattarauguB is, 
of coiirHO, very ihlTcnMit fiom Slcuhcii in one ic.spccL Imving had a well 
organized and adcqualcly hiiaiiml rouiily licallli pioRram foi seven 
years while Sli'iiben had luul rui organised coiitdy henUh program. 
However, the leiihes to the que.sdoiinairo Rimwed only slender advan¬ 
tages on (lie pail of l)ie (*jifiiuaiigijH rcHpondeiils For the purpose 
of this study we feel juHlifieil in coinbimii}' Ihcun into one area which 
will bo refened Id as the com men. Addilional data losling tho 
comparability of llie com aicu ami llic non-com uiea was not examined 
for the reason lluil only the poiliona of iho hi\ counties most immedi- 
ntoly adjacent to ('alfaiangiiH and Sfeuben were ranvn%cd. Instead, 
reliance is placed on the hiiiuiaiily between (hiLlniaugus and Steuben 
which aie hopaialed by the inlervening eoiinty of Allegheny The 
complete details am leemded m (he noeonipanying table m the oidei in 
which they me di 4 cus*,ed in the leM. Data for the coin aiea are also 
given sepaiafely for ('atfaiaiigns and Steuben emmlies 

The mquiiy iNidf laovided othei eonliols, 'Fhe (pieHtioiinaiie.s 
Were sent only to names listed 111 village telephone dii'cetoneH, thus 
introdiieing an edonoiuie eontiol, and aiiproMiiULlions to social and 
cultural contiols. In the non-com aiea sixteen village cxchangc.s 
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servinf? forly-lwo hUD Ktn.'Ulor ImmlctH :iih) nn^vioudH wore fitimpled 
III Iho com ftieo thirty villuRf' pxclianni’n htyjok lifty-wvoii additional 
hninlels were Hiunpicd This Mxleeii MlIufieH m the non-com area 
avprngo 8 0 nillcH from the iMirdcrn nf Ibi* coin area. A)1 of Hio ques- 
tiomuurcH were mailed on (ii«‘ e.iiiii' day 

QuCHtionimireHvveiorntnled to every eiKhili imiiu‘ on llichc exchnnRcg 
oxccptiiiK the muiicH of hn^iiieeH (irnw and of women Tina (rave 
three huudred eiKhly leLti'rn to (he iioii-eom luul m\ lumdrc'd eovealocn 
to the com iuimi Four and inm* lellern were rehnni'd for in«ii(Iiciont 
addroHH. Of the lliiee hundred w‘veiity-HX and m\ hundred eight 
pcitiona who presumably reeeived tl»e itupiuy, vt-venly-l wo or 19,1 ))cr 
cent from the non-com area and three hundred foui teen oral (I per coul 
from the coin area iimde miiiie n'ply Tlie diffeienee of M2 t jmr cent is 
sixteen Umes ns li\rj;e na ds i«obiihh' eri<»r 

The com area roturned 2.7 (iiiiea uh iiiaiiy leplies 'I'lim ratio grad¬ 
ually increased (liroUKhout llii* period during whieii replies weie coining 
in. The (irsl llneo daya with a total of one Imodievl fifty-thieeieplies 
showed a ratio of 2.5, l!m second three ilaya willi one huiulied fifteen 
replies showed a riilio of 2 (>, while the sei'oiid, iiiiMl,nnd fmirlh Io tenth 
weeks showed ratios of 2 7, M.t>, and A U ‘ 

A detailed analysiH of the respoiwesm |i]e,HMi(i*d sinee il Ilirow.sliRht 
on two problems of llie (pieslioiiimire method Om* of the liaunling 
ghosts of this piocediire is the Meleclton wlueh presiiinably is involved in 
the fact that Rome persoiiH refily and otliemlio not. I’lesumulily less 
selection la involved in 52 per cent lejihes Ihmi m 1!) per cent On 
the other littiid there is the (pte.^tiou wdndher the pie.si-nee of the com 
tended to (listuib (ho aimweia The data tiffer many lesis of lhe.se 
questions although in (he nnluro of llie cjim; i( i.s iiiipossilde to say 
whether one or both fuctois ore responsible for any ibffeienees Inter¬ 
pretation of similarities is equally ildlieull since they imiy mean that 
neither selection nor llio coin disturbeil (he answeih oi llial these two 
factors tended to cancel each oiIht 

A preliminary point of snino iiiteiest is linU fourteen of (lie three 
hundred fourteen respondeniH fioin (he com aiea leliiiiied the com 
Seven of these iilled out tluwiuestioiumiie in d(‘lad iind liy (loiinnenlsor 
implication indicated that they thought Ihe coin imneee4,saiy while 

‘ Subsoqucnl to llio propnriilioa of IhiK nrlirlo (on \iri‘kH aflci nmilinK tin' 
queatioannncH an adihlioiml Ion rcplioa wore r<>ci>ived ii|i to IIk' riid of the fourth 
month, Nmo of tUoso worn from Uip oojiv amv and ono fiom imn-vom lucit 
These addiUoiml cases arc not included in lliis iinalysiH 
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seven rctuined I In* rniu iluMpirHimniiuiro (»r wnli tijf (iiicslicm- 

nalrc left hlniik. Atdunu'h thi* ‘•ani ^pci'ilically "You 

do not nml "-ijin y<»tir iianM'" of flu* fouift'cn or S(} por cent 

gftve llieir nainr^ uImIo utunnn llio Mm*/* luimlu'd i'ON[KMJ(I(*nl8 

only fifly-hvo or 17 per mih jimvo iIh ir juinu h 

Thr-MxlH (jUiHlion in tin* iii<|iiir\ Uf-KiMl (lie ro‘'pomi('nt'H 

tnu‘8 on real i '•late uinounfiMl in n\i r SUHI iho pio\ ions year. In llin 
non-com urea, of an^uMiiiK llus quislion, (1:1.2 per mil 

reported ninro lluin Ijimm In dm nmi nrtsv of iwo Iiuiulrcd 
ci(»liLy-livc uiiMM’riin* diiH epm^tnm .V| 5 per mil imule llns repoit, 
The difTen'ins'IS ;{ 7 ^ inperei-ni. All of (he duiii were talmiatod 
hcpnrnk'ly for (liof-e rcpnrfint? iinno .'iml for (hoM* repoHui^ lew thiiti 
SlOO (.‘iv'v hiK. ‘^ineo no {IpfrfeneeH m ()»■ nnhiiers of Ihe Lwo f'roupH 
appeared (hoy are eoinlijm-d ut Ihe dimie^on ivlneh folhnva 

The (iral (iiu ahou ui llm tinpitiy uKheil (In* rebjumdenla In rank four 
funcUoim of puhlie lieaUh work in niderof iniporlanee. Forty-eiKhl 
from the non-eoui area and oiio liundiet) (Ifly-en'iil fioni the coin aiea 
properly folloneil neUinehons iii raiiUiii)^ I lie fom futmlionH, The 
perceiiluKes of eoiieel r,lnKnl^^^ for fiiiielion (a) were '17.0 and M,J1 per 
cent, for fnnedon M .{ iiini 77 0 jmt eeiiJ, foi function (r) 27.1 and 
30.7 per eenl, for fnnelion l^Ij .11 2 and .11 0 per ceni 'I’lie laif^e«t 
differenee heie JM Oil ’ .10 per eenl 

The WM;ond, llnnl, fonilh, and liflh iiiieafioiiH eoneerned fiinincml 
supjjort of ]iul>he Insdlh work Favoiiihle nlliludes were exproswd 
by answeniiK "No” lo tlie eeeoiid (luesliiiii and "YeH” to the (/hird, 
fourth, and lifili Koi (lie noii-eoni and eoiii aiens llie pereontuf^es of 
favondde replica wine 70 t and 77 \ pel rent, 711.1 and 70 1 per cent, 
41.9 and dO .1 ])(‘i eenl, and 7.1 H and 77 2 per rent. Ifeie the larKent 
(lilToience is only d I pei mil. 

We dun tioM (o ()»• eate wdli which fhe mrpuiy iva.s anhwmml hy 
the two mens Mh mdiealed I>y llie iMopmtion of omitted or nnccUain 
unbwoiri Iiislead of heveni y-l wo and ihiee Imndied fourteen cases us 
oui base we bhall i^e .seveiilv-one and lliiee liundicd seven since one 
vespoiideiil, fioni llie non-enm aiea wrole (hut li(‘ had mislaid his 
(lucslionuain* and seven fioiii llie nan aiea leliirned the coin willioul 
answennp; any ipieslions For the ni\ ipiesliouH (lie rum-cnin area 
avei'uneH 1,1 () p('r cent, omnsions oi uneeilam nnsweis while Uie com 
aiea aveiajjes 17 0 pei eenl AimhMs liy himcirm qne.stions, Jiowcvcr, 
reveals one Hij'nilieanl diffenmee. ()nly .‘12 t) per eenl fiom the non-com 
area failed lo lank the four riinclioiis of public health as instructed in 



050 


The Jaurnnl of firhtnUwmii 

comparison will) 50 ! iht rrnt from I In* crHH urea. Tim diKprcnce oI 
17.5 f>cr cent is Tl times «h larKf* n« ri« pmlmhli* error. On two other 
qupBlions Ihr* onin nrenrhowofl iiiort* while on flui other three 

ll Hiiowcd fewer omiKBion^, Thn Inr^est uf thr-M* ilifTpronccH Is only 
0/2 i>cr cent 

Tlip respondenls from the luo irn'in were ofiimlly ri'iidy to back 
their replies with (Iifir p-i|?nnlim',s. Alllmugh llic qucHtionnairc 
npc'cilicnlly bukI, ‘‘You do not need to Mttii your imme,'’ 15 5 per cent 
from the nmwrom area turned lluMf iiume«. Afli-r doducling the 
fourteen cubph who returned thn coin und iniluriilly wnnU'd to receive 
credit for it there remain IK.O iht cent of iho iCHpomlenlH from the 
coin nrea who Kavt* their nnuiea 

A final Uml of the inrtuence of wUmlion and nf live com is the mlcml 
indicated by comments. Theiu* worn iiiviled Iiy "IVe (In* rcvoniosKlc 
for comments" fnllowinR Iho hiKlh (luimiion Friun the non-coin area 
44.5 por cent made commeiilR while from the niin an'u only 113.2 per 
cent mnde any cominenls. Tim differBUre of U.U per rent is only 2.0 
timea oh lar^o a« its prohulde error. Whih* u Mimller proporlion o( 
respondents from the com area iimde eomnimiis, »1 h»m‘ who did so 
made more and loiiKor (’oniineiiln. CounfinK eueli (imdinciition to a 
Bpccific question and earh pnriiKrnjdi »f disr«*’’^iim ns n nmimeul, tho 
non-coin area averagen 1.7S cnrurnenlR per person coimnentiiiK and 
.79 comments per person replying. In the com iiren lliene liKiiresnro 
1.92 nnd .01. CounliiiK all words in tin* eominenfs ^ives an avorngo 
of 30.40 per person commenUnp;aiid of V.SJA) per piThon n'plying in the 
non-coin area in comparison with dSdi'd uud 10.25 m llu* com area. 
Tho mostfiiRniticant of Ihese differeiiees moiily 2.2 limeH as large as its 
probable error. The differoiices nri* uNo exajg^ciiited lieciuihe these 
measures arc the ones in which ('iiUuraugiH approaches Higiiiiicant 
fiuperionty over Steuben. 

Tho relative coats of tho two procedures nu* of Bome inteicst. No 
expense was spared to give llie inquiry a fuvomhle appearance The 
lotkors to tho non-coin area cost 10.4 ccnls cacli while Ihosi* to llio coin 
aiea coat 30.5 cents. T'he Uutial n\ponse to the lom aiea was 250 
per cent gicritor per letter. The huKcr piopmlmn of icphcs leduced 
this discrepancy very much. In (smtH par icjdy of any Kind, llm coin 
area exceeded the non-com area hy only 31 per ccnl In cosLs jier 
relatively comploto reply the oxem for Iho coin aiea svim only 32 per 
cent. In coats per reply contniiuiiK one or moio coinnients the execs'? 
was 80 por cent. In costa per comment tho (*m' 0 ss was (11 per cent 
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In costs por \v<ir<I of c'uiiiiiu flir* rtuu im'u I'Xivnljul ihf unn-rrnn urcn 
by only Vi pi'r ci-nt 

SrMUAin 

The enclo«un* »)f n hsciily-tivi* r«‘nt pn-rr in u miojiIp ipiehljiniiiJuro 
sent out hy nuul nl.O ]M*r < “»f n'plicH wluh* Ihr muih' (puMlIon- 

naiiG n'ldiout (In' rojn rrtunn'fl ojily 10 J prr renf replii"* 

Taiu i: I «•*» Data 

*•• 11 ' n> I <<iii 11 flllAraAii* Ht«til>en 


' IVr 
\n '•(■nl 

} . T U 


VillBgo telfliilii'Mc <>*'■1 I 

Other Iminicte lU'-tmle'l 

Innulrici iiiailrtl 
ileiuniert (<ir KildmR 
I'erioiw recflvitiR in'iuiri 

flepliM of any kind 

Ihet wa* r»/4)Ai>l 

neturiie^l c(<in «ilh Ai<turf"| ' 

lieturned com Miitmul AntwriinR «|>ireh' »• 
Uiealle returne 

Heported Ine lliari IlfVI Iaim 
I(« j)uclc«l inurci lhari ll<Kl tai'A 

Correi'lly rniikitiR » oi 

Corriyily tnnkiiiR (iiiirtl' ii rA't f*i * r tf, •.h-I 

Corrci'lly rnnklnti fmi'O iti *•*< lV>r«1 

CJorrtCJly /AHkJn*! luiirltuii IJf r •r-'-mi J 

Corrcftly AimwffitiR *i‘i 3 ”N<< ' 

Cotronly AtmMcridit ’< kA**‘ 

Corroclly BtiBncntig i|ii>-nn>>ii .\m 4 'ir-i ' 

Correctly oTXM'criiiii riuRAlitrti \i» >*• \e>‘ 

I’ncerlHiri ur utniltAil nfii tnn (•teiK i 

Unccrlnm nr (•tiiiltril rr|i '»s 
Unrcrlnin rir lAnkit u > (fu'K 

Uacorlnirt or iimli{<‘ii at Kuris (<« *-••• 'i 

Unccrlniit or tJHiUj' iJ aiii* rm N»» J 

UQcctlniii ur iiunttA I nrmA'rA t < •|l('■<l|||.|| Nu 4 
Uneerlniii ur iDiiilli d aiu'uiA (•> ■{iirBiiiiii Si> 't | 

PerBona ttrgnfr'K nnriici ^ 

ncdurlidR (oiirtrAit i.iira K'ltiriiiriH •■•in l>*php 
of wliiiiii aiKiiAtl iiniiir i 

I'erfloni timkfiiK rniiitiiniilB 

AverARd iiuiiibir nl rmiiiiiriiia prr rtmi- 

incitlinx 

AvornRAnm/ihi’r n/ wj i.f# ii>rjx’iti'mri>iiii»tnfinK 
AverBRO iiiiiiiltrr nf > r>tiiiiirii(a iirr prinmi ri'iih* i 

1 

Avornxc iiiittiliir < I Mtirtin Iti rnHimrjiii |irr |>Fr* 
BOIt TAftlylHR I 

Total ei|)t<iia>i nf a< ikIIki' liuiulry lit ll••UAlA 

CobLb por Inllrr wctil mil lu caiiU 

CoBla pnr rciily (»f Any kfnif ft»«< nla 

Ooste per relntl%el> rmiiiilriA reply in rrnli 

CdrIb per rotily iiny <iimtiirrit-in «riila 

Coat4 per rmuineiil in nnla 

Coats per >Minl of < iiiiiukiii in i (‘in'! 


I'l I ill Al 


lAII Ai 0 


1 • dj 

?l IM 7 m,' Mi r. M'l M 0 

' r. mu i.’ii it n ajL h h 

4i oi J , ini, :> B'.i 01 y 

' I ' i 

i ;m 4.* n ■ 7ta; 4t .l 'tl' 4» (I 

}4i .1 />’ II nil V7 1 

i.i' j; I ; AH in } yi ,0 0 

I yn' M .• hj' m }i 4.*. .M 2 

I ' ' 

Wl /tl 4 31.". 77 1 im 70 0 

4 li ;«> ;• 111? 7)1 I U7 71 0 
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flR 00 0 
Ki H 1 
n ft 1 
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Tbr Jmtmil ttf Edutnluiml Pm'hfiloinj 


llrtHiIrd unnIyf^iH iif llit‘ filiouH nffili^ible 

(lifTordiro Ih’Iwcimi tiu' iinri-rtiiit m\ roin urrii*^ ()ii (iiu* riiic.slion diu 
rrpptmdnilKfMm llu* com am Hnuru-uiidy umn* oin^niomor 
iiuccrlmu aiisniT.*', but rniHiIfnim (tiui“'HUiH mid iiii{Trl:im m\\m 
to all ([UcutioriH llir uf llio lUrti-rniii an a mily t! \m cciil 

A larKi'i' iir(i|i(irlion of ri'‘*|Hiiiihih from ili" nnii^Mnn .men ii^o 
coiniiiriils, bill tlir roiiiiiifiiis nf n lutiidimfji from iiu* rniii hki^ 
tcndiMl to be loiij^cr. 

From Him of iliffiTcnns in tlio of tlio mm-com 

aroafl (o llic iiiicsl ioiiiiiii]i', one 4 llie folinn iii|( iiifmemrs ih umiiuitcd. 
NciIIkt tlir .Mdi‘('(i(in invitlvrd in a Minll pioitorlimi of reply's nar Hic 
prPbence of (he rom \m ilHlurlmif; (o llio i(‘itlnN The inlliK'nceoI 
eeloctioii and of the eoiii nimrlled (‘mh odii-r 

While Iho iiui lal rmal of endiwiiK n (tten))-live imiil, pieiie iiiiidc the 
Ictlonn to (ho com area ^2'i\ |H*rriMit mine e>,|H'ii4\e lliiui IrdliMw to the 
non-coin urea, Ilic lari^er ndiiriiRfroin ilie emu mea reilocod llioo^ 
in teriiiH of unit cohIh im low iw Ili |M*r cenl. At (lie niohl \k actual 
exccBH eKiieiiHO is KO per cent iH‘r uml of rdorim 
Tho piocediire of iiayinpt (lui vieliniH of a iiiiesiionimire ih rocoin- 
incndod, not for mioplioii, but for woioih cnnuideialnm In torina of 
costfl it (lid not piove Hiipenor in thm uiHlanee. WlielliiT on thn whole 
it was superior iit the proHcnt caae m a nmller of imlnment which must 
go beyond llio actual (lata in evnhialing (he Inipojiaiiee of ficlcctivc 
factors and tin' podhiliiy that the com ilwlf wii4 a iliHliirbing factor 



IimUKNCK OF 'rUK ASSr(;NMKN'T ox FFARXfNC: 

DAvn) II 


1 (nri'In fViH*}/*' for 

V M JOUKAN' 
Tiiivcr of Nurlli (Virohitd 


'['Im more <4 ihi' as an insh'niiU'Ut 

of in^lmchon ))as Ihs'm iIii* lamli-n nf imirlj lait nf liltlc 

oxpcrimojilaljoji llrm/f wiih-rs •’iirh a.v CrauffwJ nml 

McDojiiihl, SinJHs «ml Mimrnn Iin\r mil llio iiml for 

jidcijimte n^S'iKiiini'tiO (»f Ry "snUspmln*’ Ibcy ijn))Jy Llmt 

nssiKiimonts hiiniild \n' d(‘!ir, In'ipfnl i\'* (a Khnly prorcsliirrs, Hliimi- 
IftUngj luxl llial tln-y hluniM Hran*-!- pi<il«I«>iiiH in Ix* f-nlvrd With tho 
outcomes of Uu’M' flmy liavn nnl nmcrnusl dioinsclvos, II 

has Rcoinod In ns wnrihsvlnli*, ilinrnfnrn, In iiivi'stiniilo the ainoniil of 
ftdclcd lourninn wliicli nccriins from nMium proci'dinca. 

The tvHhiunnu'Ul pnnsslnios, ||\r m mnulM'r, wino cIiohou becaufic 
of Ihoir gcnciul um* rulloT (Imii lH'nui«n lh<*y an' tlio boHl. T)icso 
procodurcH am. 

(a) Tlui pupilH ri< rMriuttUnl n HMgK4'»l<sl Hlndv proroihird wlncli eoimiHlcd of 
looking up irK'iuniig nf ililficufl MnniH, Hrn%MiiK Iiih-h undi'r llio imporltuU aUlo- 
incnta, and lf'nr(iin((Uu'i'igiiifi''faao«r dirftUN'MM’ntsprf'Viutnily undc'rhnod. Orpal 
Cftro wn« Inkon Ui tiiako »uro Uml iln> |iu)mIh kiicw «*xnflly wiml lln*y wore to do 
boforo dicy wi'rc nllnwcd to Iukiii 

(i) Cnn'fvilly Hcloi’d'il 4pic slionn an llm iimlvniil U) hpatutiinil wurn given lo tho 
pupih licfnre (tu’y la grin KfiidvniK ’flu* iiislnirdoiiH wrro "I wnnl you to Hnd 
tlio luiswcrs to tlictfo ipii'jiijoijs, rtml yon Iinvo found Pioin dmw a lino under 
Iho correel iinasscr 'I'rv lo h’arn hh innnv olliH fuels uh you can while you arc 
reading uiul Ntuiiying lln* tudiTlioa ^ on an* to uhu thran (iik'hIiotih na a gmdo ui 
helping you lo iiumli'r tiro poiiilH hroxiKtit out in thoHoh’clioii." 

(c) Tlio piipilu iw'ro tiurglit (ho nK'iinuig of llio di/liciill words in the nmtcnnl 
lo 1)0 Htiiilioil A hIii i'I wtiH pr4‘Ui<nti<(l In ilir pnpila eoiituiiung n list of llio inoro 
ihfRruU wordu xsidi tlieir uppropTnito inciiiunKH with lht*ai> uistnir,lions "After 
wo have Hjiriil olnnil (eu imunli’H sIiuImiik Ihcae hunl words I run ROinp lo Rive 
you ft lest lo Hco linw uiiiiiv of (iieni \nu have leurned 'I’lien, (oci, you wdl need 
lo know llii'ir nii'ainnK»i ai nrdei i<» nimwiT llio ijiieiilions vou will bn nsked later 
on in till' iniH'iuge yon are in rend ” 

(d) Allenipl \mih nmih' lo aliow lln* eliildren the niaiumr in wliu’h llie laiiff 
(Ihosulijeot of llio iiiiitiTiui u(uilied) ulTeeleil them perHoiniily lIliistiatiooB wore 
prosoiilerl «f IviU'S of RooflH nmde riuire < he«|i!y m foroiRn hinds tlnin we could 
leauufaolure ni tlim eiimilr> beenuHe of the lower HlimdurdH of living obtaining 

(i"i» 
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there Ihnn liero Tlio ordinftry ingh larilT nrKiiiinml |)rtwi\lp(l which cinplia- 
Hizcd the oITcct of lowcniin or rowuiR the lanff on wokch nnil rnniily mcome and the 
coiiacQiiciit cfTccL on llio pupils thoinKpIvo*! 

(a) In tltia coac, Ihcro was a ronfirioui nllciniil U) cxiilnin what llio taril! 
wtwi, why Romo thought it a good mrasuro, wliy it is nillr'd a prolcctivo tariff and 
why it was levied. It was cmphaHizcd Hint nmiiy of tlu' J)UI)i1h iniRht differ from 
Iho Prcaidcnt pohlirnlly but tlint it wna their duly to Irani iimrh about a topic 
diflcuBBcd in Congreas at that very hiue. 

Tho material uecil wfw Hclcfttcil from llio iiK’SHaRo of President 
Hoover on iho general Hubject of the tariff U coiiHiHlod of two pages 
of single spaced typewritten material and was in nature more difficult 
than the ordinary rcaduiK mailer used by pupils of tho levels studied. 
The four pages wore divided equally into two sections, A and li. This 
could be clone rather easily and naturally since there was a bicak in the 
thought at the point of division For each paragraph there were 
prepared tliico sorts of material. Tho first consisted of a Beiies of 
words cho.sen from the moie diflicult words of the text witli multiple 
choice answers Tho second type of Tnalerml was a tost of sentence 
meaning. Care was exorcised in making the answcis depend on the 
undetstanding of the individual ecntcnce and of that alone. 'I'he third 
type consisted of statements bused on tho interrelation and meaning of 
several sentences taken together. Bometimes these quoRtions depended 
for their answer upon tho interpretation of what was road. Thoso three 
types aio callcdi (1) Word knowledge, (2) scntciico moaning, (3) para¬ 
graph moaning. Befoic tho experiment proper, this material was 
checked for its difficulty (1) by counting the number of words in each 
selection more diflicult than the first five thousand in “Thorndike’s 
Word Book” and (2) by testing the mnlcilal on two hundred forty-one 
cases located m Grades V, VII, and IX, This last procedure furnished 
us with the following results: 



Word 

1 knowledge 

Sontenro 

ijKMvniiiR 

Paragraph 

meaning 

Form A , 

■n 

0 05 

■■ 

Form B, 


1 h 


Difforonccs of mcftna 

■im 



PPditi of means 

37 

■■ 



The PE of the differences of tho moaiiH showed the (liffcrcnccB 
between A and B m sentonco meaning and in paragraph incaiimg to be 
reliable The difference was unreliable m the case of woid knowledge 
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Influence of the Attnignmcul an LmTuing 

The {iifroroncpfi between the inninR wrrp provided for by prCHCUtiug A 
and li in altornaU' niimin'r. If thon* were two praties, iu tlie one wo 
used B for tiui eonfroi group niid A for fix; cxpenmonliil group; in the 
other, A wni ihc eonirol and li, Ihc p.\p(TJinf'a(Hb Tlie correlation 
between the two forum was 8ft }* .01 

( u\i/ I'liooninniii 

The five Rltuiidons woie (crNmI in Ihe Durliam niul lialeigh, N (h, 
flchoolH. 'J'xo groups of Icfth, luo of wveiUh, and two of ninth grade 
pupils were Hul)jei'ts for each of ihe e\perin(eiilal Tilts 

made a total of out* hundicd ai\ty-sevi‘ii hubjects for Absignmcul A, 
one Imiulrctl eigluy-i,i\ for Ausignmeut if, two hundred fifCeoii for 
Asaigniuent C, one hundred eighty-nine for AHHignnienfc D, and one 
hundred ninety-four for Att‘)igiiiiient P> nine hundred fifty-one fiiilijocts 
in all. Till) saine e\aimii('r fUnggs) gnvc all the a^'Signmonts and all 
the tests to each of tlje Ihiriy groups of juijuIh, 

The geneial plan wm t» lesl the nhildirn fiiat with one of the 
forms on one day, I lien the ne\t day iimke the nssigmiient with the 
other foini and calculate, the (lilTeieneos scoretl liy pupda who on one 
day were intluenced by certain types of assignments and on the 
other wore Jiotho iniliienned. The loijj] ijme coimumed by the pupils 
in these proceduioH was fioin UnrtjMive to fifty nnimtoa 

Ui siri/in 

The aveiage K'sults only are given on uccnnnC of the lack of space 
ITiii.h f lUsiii/ra you AhatosMBNT A 


(HugKfftA'd »Slu'lv Promliiru) 



Word 

Sonletioo 

PaiARinph 


tfiowlcdgc 

iticnani^ 

men rung 

Control * 

ir> 5S 

fi U 

4 73 

Expcrimonlai i 

iH m 

! ll '13 

4,80 

Numboi., , 

111? 

1(57 

107 

PilTcrcnco of uh'iuis 

ft on 

00 

07 

of iiieimH ' 

Cui 

■id 

10 


In atudying 'J'nble I, one WHlniiik by Iheshglii. (bl!ei'oncp.s between 
the moans. In the aiMite.iice meaning und m puiagraph meaning the 
difTorencea aic merely eliance difteiences l)ut iii woitl knowledge there 
was a reliable gam due to tiie asaigninenl. It m to be icmombercd 
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llu' vrry <»( A‘'-»Kniucn( A ftlnnmj forcod au improve- 

input in voriilmlury }»nin' W PniiMwivtl imikiuk uthrr IhiuKrt of looking 
uj) ihc mpuninft of diflif’iiJl uonls Sinn* we luul at onr (li*<pnfial tlio 
rpcnrds of Hovrml nmdc-t i( nol dillu'idl to got au aviTiiuo Ram lot 
tho ypor m e\\v\\ of tUo UM**. Tin- hvciuho vn\n por your on the vucabu- 
liuy U’Hl WHS;{(17 iv<ir(l‘t whieh m jiitl :iliont (he wiiile ns llie improvo- 
mpn(, of thi' v<icithulary Kporesnsrirr-ult of tins pKK’cdnre The mean 
gam per year for M‘id cnee mnuiiiiK wim SI qmMunis and for paragraph 


TAurr. II- R* I'm* H 

(A«'n( of IVrliiu’iil Siudv <i*n *i}H(tis) 



, 1 

Word Jv'iUvuve : 

kiiitub'ilgn riieaniiig | 

PutHRtRph 

inraning 

Control 

Expf'rinieiilfll 

Number 

Differcrn'O of nioniiH 

PlO.iifi of Illl'lUlH 

! in IS ' <l .ft 

i Hi ;tl 1 li 'i.'i 

IMl ISii 

11 '..Ml 

47 ' 21 

4 78 

4 88 

isr. 

10 

17 

nieamug .Tfi querttunis AUlumgU (hi* uu'uimigs of (he srords were 
studied and learned Huflicienlly well to HToginye liieir eon eel meaning 
among five wortis tln'y w'en* nol IimiihmI MinUneidly well in Die lime 
allowed for them to have entered min lln* \v»rp and woof of Die ‘•eidencc 
111 such a inannei as to nupiove iIk* mshcs on Du* sentenoes iiiid 
paragraphs 

TaIILK lilt l»K A^UUSMFM' (' 

(Teiielinin MciiiiUK uf DillimU Wurtls) 




1 \Vor<l j 

Si'nlence 

PiiniHrnpli 



. iue»\iu>n 

1 

1 uu'iuung 

Control 

Ifi Olt 1 

(i:ii 

: '1 71 

Expornncutnl 

211 WA 1 

1 a (»a ! 

.1 0,1 

Number 

21.1 

2ir, 

21.1 

DifloiGnoo of nioftiiK 

U lU 

211 

20 

PlOiinr of iiiOfuiH 

11 

2(1 

10 


It 18 deal horn Tablo II lliiiL the ussignmeni, of pi'rlment Hlmly 
questions had littlo if any deiiumsUtvhle I'osuU ou wmd knowledge or 
paragraph meaning and a Blight Imt uniehahlo ('Aoct on undci.Mlumling 
the meaning of sentences. 



Ihjhuurr «/ ti*r (m Ijfnrnwg 


tiOJi 

It J8 apparpnt llu*# tli»' !• nr«»M| m Jht* f-MiKTiinonln) ^froiip dj<J 

joBucnct' Ihf ni \u.r«l Vwwl *!?»' Mfirr !nt(>n“*tinK ])f'ihap8 in 
llicflinflll in “oiPnir ;iiul juir'i^raiih nii'iiiiiiig wlion w) 

many of th*' "i«'r'i8 IokI !*< i-n i« .<Tii‘ A 'I lu’ uiiiintsrnu'iil looinw Inr^ot, 
howcvor, will'll r'inij»!4r<'I wifli Mi*- \fMrIv pniwfli «if Hi (|»if'HLi(niH in 
(hc!W?n(<'nro inoonuM^ and *.f T.** m (Mrf«Krn|tli im'HfiinK. '(’lie difforonw 
belwfon Hjo nnn'iif’il m»'I tin* r<.mr't) jm w<*r/l Jimm-lnlKO /h’oiIn no 
commonl wu«* ('OiKlit iln* rlnldron ilirnjtly In 


T^ici) n »j /. ur A I'lSMrsr If 
l‘n|»dp .\»ur»' «*f Yahn* of MiinTiiilH) 




1 f’k'iileiira 

I’ftrnKrnjdi 


'lie* 

, nii'nniiiK 

ii'ientiiiiK 

Coni mi 

17 s; ! 

n Ml] 

R .13 


IS AT ; 

a sj 

fi 4H 

Numl'rr 

ISM i 

ISII 

ISl) 

DifferPiioe ef luvniix 

711 1 

' IM ' 

or. 

PEjtf of nenitH 

.... j 

'^2 1 

1 

IH 

ficntcnce ineinnn^' tie* (Itniuos mo '.iMv-two ni a hiinihed dial if Iho 

oxpcrhiK'uf wen* ropi-'ii* <1 

lie* ( sprriiiM'iilMl i^roup woulil still Im tihuad 

oflliecniitnil^ronp In i 

la* (■ no of p-iramaph iiieuiiinKHnniluv cliunccs 

arc W'vonly-eiiihi in a ImrelnMl ‘IV-ivlnnu the nieuniuK 

; of ihIHoult 

ivordK, ns far as onr ennlv 

I .. li'is a flrcitlnl ( 

•ffeot upon l)i(* iihility to 

coinprc'lioTn) itn< nieanun' 

of and paraKniidiH 


'I'miIi \ 

Ui ii i.'i > tty Ai ».|t.NMi,M’ h! 


(NhtKiitK J'liialx A»’>r«> 

i.f itif i5»*w*r«l HnfKttroniHl of ike Malennl) 


' Wool j 

Sentenee 

I'urnKraiili 



iiionnniK 

inoniiuig 

Conlnil 

17 -Vi 

ft 77 

5 48 

Expcriiiienl'il 

ts <l'l 

7 1)7 

5 r/U 

NhiiiIht 

I ! 

MU 

11)1 

DifftTrncii cif lilt’ oi'i 

1 

10 

11 

of an iiiH 

, i 

.TO 

10 


As a nsnli of jojiKinj; pupils av^nic of llio poi'snnal valuo of the 
Inriff, Ihcic wiis u fuiilv sij'iulimnt Impiovoiiu'iit ui woid knowl¬ 
edge. The elTecls on •'eult ik i* iiieauiiiK puiom'iipl^ nicainni; wcio 
ml 




661 


The Journal of Kdncational Paj/rhnlogy 


Making cliiWrcii aware of tlio general Ijurkgrouiul of Uio material 
fatudied proilucea n positive effect in the (lure tyiies of (vnawer required 
of them. The flitTcrencea me not Hlatisheiilly reliable but nil of 
them are positive and in (Ise, same directum. Compaie those differ- 
encca witli a ycar'a growlli of 3 08 in word kuowledgi', 81 in smitenco 
moaning an<l .75 in paragraph iiieitiiiiiK anil it ia clear Unit a few 
minutes of e.'(plaimtioii biingn about ' ( of a year's giowtli in word 
knowledge, H of a year's giowth iii honUmci* meaning, and of n 
year's growlli in pariigmiili iiieuning It will be hoon that tho 
improvement i.s greatest in wiitoiice iiieiunng and least in [laragraph 
meaning. 


TaHLH VI—MUAN (tAINh IN KaCH OV TUB HllUATIOfiH ITU TlIKlIt I'llOIlAUl.E 

lOitiioiiH 



Word 

! 

1 


I’nrnRrapli 

Num- 

j 

kiKiwIi'ilgo 1 

liK'niiniR 

incniniiR 

i her 

(n) SugRcatcd aluily procedure 

13 OS.' \ 

.53 

011 1 2.1 

07 1 

11) 

; 167 

(b) Pertinent Htudy (pic-^lionH 

- ir. 1 

17 

I 20 »- 21 

10 t 

17 

186 

(c) TcnchmBniPnniiigof vvordH 

(d) Mnlcing pupils awiiro of 

jll 1131 1 

•11 

20 1 20 

1 1 

10 

216 

pcrHotuil viduo nf lunlorinls 

70 J 

•il) 

- 01 i 22 

05 1 

18 

189 

(e) Developing background 

1 77|J 

■17 

1 ..0| 1 20 

11 1 

10 

191 

AvornRO yearly rjuii 

.1 OH 


HI 

77 




Table VI summnriicoB the lenullH of tins mvi'.stigalion it will be 
seen that the scores encircled arc as largo or huger tluin thoir coiic- 
sponduig piobablo errors. I'Vom tlie hIiicIohI statistical point of 
view only Assignmoiits A and C me lolialde for in these cases the 
difforoncGS are more than four times the piohalMo enm of the diftoiencc 
But in these eases the teaching diieclly influenced the scoies on Word 
knowledge. It is clear that the leaching of the meaning of woiclspio- 
duced an improvement m sentence meaning of 20 of a iiuestion oi a 
little loss than of a year's growth and slightly moriJ than M 
a year's growth in paragraph meaning "riiis eaieful leueliing of the 
meaning of tho more dlfTleult words Hlnmls out as one good way to 
make an asaignmout. Another method aliiiosl jih (‘IToetivn is tho 
dovolopmcnt of a backgiound for understanding the nnvtevuvl to be 
studied. This background of understanding is of undoulitcd asHiatancc 
m comprehending tho meaning of tho material stiulled. 




Jnflumtr »>/ /Ir A 


665 


Since lhm‘iLH‘'iKnnir‘n<^ vv( n- in* A mir uj»<*n V, VIJ, anrJ IX, 

opporlunily offrrry} f/j Hnrly f)\<' iliffi n nfml i-ffrrl of the uw^ign- 
ment upon cocb unul'-. 

TmB VII )->nr**tiv»Kr >-s i,r thk I iv>; Mi'Tijcmn nr hUKiua 

THh ‘•T O', IiriJf, A’«W XihTU ^JtlADK Pl'I'tW 

Cfvli* S’ j tirnil<’VlI ' (IradnlX 

fi i 0 

i' K j H 

»> j: I ij 


Word kfi(jtv[cdK'' 
Scnlcnco itirHiiiuK 
PaiagTftnh w !niuvK 


Tcaclvinmhc moaning of ilu* «!ilh<‘)il( woril IS»i\ii\iioii f) rmisod the 
grcafesl Raui »ii vvorl kr<owKvJj;o ff»r carh of (he fltree grades tested. 
lifnkmK pupils aware of tlu'general iiieaintig of the inalenaiH (SUimtioii 
fi) caused lljegfea(<‘j.( gain in H'liteiiee ineahing on the part of fifth niid 
sovciitli nra<I(‘ pnpiU wlute wilh (he niiiCli gnule it was tlie asaigninont 
of porlineot rpK'Mlnnjs (Sidialion H). In devehipnig imragra[»h moan¬ 
ing, making tlie jaipil^ a>s.ire of (In* perHoiml value of jnatenalH appears 
to bo boat in (he hf(h grade, uliile nuiking impiln awnio of (he gciioml 
background of (lie materia! aiudieil m imml HU€(‘e<^Hfiil m Dio sovcnlh 
grade. 

While the gains in (In* exjieiiinenlal sHnahonH over llm control 
flituatioiiH me nol ^(/{(isfleaUy eignificuni, except in ( wo enxcis of word 
knowledge (SiluainuH A »n»l t*>, yeV our data show stiong imlicaUonB 
of the infhieiiee <if (he as^gnmeiif. 'I’lie coii‘s!,slency of the gain, tho 
fact Dial each ly]H' caused a imiiceaide gum on (he part of nno or two 
of the grades esanunetl, (he brief dine for acquamtiiig the pupila with 
the apccificj jirocediire use<l in I he avsignmenl, and the largo per cent of a 
year's gain in many cases, me cvidenc.es of the nnpoilanco of the 
assignment. 


Ur.i I ui.Nri s 

Book, W P.: 'I lie I Irvcliijnix'iil J IialMT'D/UcrH of I'lscrjilumul IIai)lla m llcnd- 
lag Jfnir Ut'uurrh, V«l -\X1, No a, M<iic)», l!WI). 

Cnnvford, <;, C. mut McdimiiM, I-<hh I'. "Mjidom AfoUid.lH of TofU'liiiiK Gcog- 
Rrapliy." IIohIom: iltaialtlnn Milllin (loinpniiVi lU'iU, pi> 

Jordan, A. M.: /v'dt/rnnt/reit I'ht/chuUiffy Ilemy lloll it Co , LU2S, Cl\aj) IV. 
Monroe, W .S . “JJmrdnKJrf'aramg m Ihc High Hchwd " New York: Doubleilay 
I)or«ti i^ Co , i(]2S, pp. ‘UK 12(1. 



666 Journal of JCducaliimnl Pnnrholoffy 

MonroJ', W K niirl Mohlninn, K.’ TmiinnK in tin* Ti'clinnuip of Study. 
VtuvpThilii (ij Jliimfi JtnUrtin, Vol XXII, Xri 2, liurcau oj l^ilucalmal 
licpcnrch liuUftiii No 20, t^rlniiin, 1021 

Odell, CliiirloH! Tlie AMiKuttinil (»f VnufTfitt/ „f HUnttm fUilUhu, Vol 

XXIII, Nn. 7, Ofl 10, in2r,,j» I 

Hcuth, J II t “C5liwr<Him OrftumrHlnm ninl fV*iilrol ’* lliiHlon. HoiirIiIoh Mifllm 
CVj., 111211, ]\ 220. 

Hloiif, CJ II "Su|n'fV‘iKnm of lln‘ Dlnuiciitnry .SlnHil" Houghton 

MiHIm Oo , 11120, p. :ill 

Wnplofl, 1). “l*rt»cc'<liirf* ni IIikIi S«'liiHd T«‘*i«littig ” Mnrtiiillrin f’o , 1021. 



factual .MK.NfOIiV OF SKC'OXDARV SCFfOOL PUPILS 

FOH A SHOUT AUTH'I.K WUICU TUFV UKAl) A 

S1N(;T K TTMK 

Al.lltllli. 11 U. 17 .I, AMt (il.dln;]. i: JOM H 

^ iiiVi ><>]*> 4>f 

{('nurhttUtt Jittui Kffinnhrr 1 ‘i\up) 

Comparmou nf (trmip Avt/nf^*' VII ropoiils tliB avora^CB 

prc.sonted iii Talili“< I in Y’ iit Mirh si inahiHT suh to ravoal llu\ inllucnco 
of Inpsr of tiiiio (.<» atnml of nn nrfis’lfi rniul a smglo 

ijiHO. U ih olojsr from fh/*>c ihal W’lfh of linio pupils 

rcmoinlsor fowor and fowor of tlm f.iols roiUsuniMl hi (ho articlos. 
Grado by griu!i' ihhI nriiob* by urlirlo iMKhly-four <*ompitrisonH may 1)G 
made l)i't\\(' 0 u “m'cow'.ivo iiilorvals Willi m\ oxcoishmiM, only one of 
M'hicli is Jsirgc <'iioug)i lf> bo Mgiiiriranf, Ibo jjvoiiigos of any given 
Interval nro sntollor titan tlio*.!* of (be iiMenuF ineeetitng. Tins Jh 
nolcworliiy in vu-w «if fbe fuel lltsil (lie bgnreM joo Imsctl tin gioupa of 
varying iibibiicM 

'L’lilslo VIH gives ihe A«‘«eore Slvedlge^ foi lilt* coiiibjlHMl gioupn.® 
Average stmres tlene.-id* eou^.isleijllv ivilh (line In the figuies of Una 
tiiblo. 'i’lie ('(»nelM‘’i<in hcenm waiisiiiK'd (Iml, witluii llio lirnita 
of tlio in'e‘«eiil slutly, Ijiegreiiler (In* iiileival between liic reiidinRof iin 
arlicle and llit* ‘'Ulisetpieul u((i*iii)il to reeall iia otnilenC tho Rioatei ib 
the forgettiJig bn* (be fuel'' eonisiiued 

lirtfulla (if (iuiufiiy 'I’be ab«v<‘ fimlniKs woro checked for 

accuriKiy liy umuir (lie mediod of etnuvsilcnt Rrotips One hundred 
cases were ‘Jeleeleil fimii esieli t>f the hi\ exponnionLal groups on. the 
basis of A>s(!oies m nuiiiediale memory in mieh a mimnor that the six 
rcsultiJiR RUJiips ueie e\ae(ly eipiivaleni iiniJ lli.'it ilic A-scorcs of 
each weie /loinially <il^(i(b<i(<‘<l Smee Tdi.? iinppeoed to bo tlie 
A-acore uvm’uge of (be eoriibiiied Kimh'a, we wlecleil 5(5 0 as the ineiiii 
and H.b us (.lie Hluntliud df>vialmn of the new jmiallel gioupa and Ihon 
eonpniLed llm liiemelinil fieiiuencieM foi hi\ olnnH lutcrvalH of four 

• Soo lirrtL liiklf f)f I liw nriH I« ii» pii'Vions imhuc> 

UL Hhouid III- jcoillcd l)mt ihe A-sPtire uvcnige i(‘3>i{'soiils llio woilc of all 
Bioiips liikt’j) Itiirfiber in (eruiH of ihi* niali>n»l AiKwriglit 

«a7 
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points cnch ahovc iind hidow tlio im*uM in n normal curve witli moan 
and fltandnrd flcviailon a« aliovo niMi urea equal to one tiuiulrccl The 

Taui-k vie AvF.tiAf»B Mk^iout Arrr.ii Djirr.HRST Istkuvakh* 


t}rf»(Ir-J< 


UeenH iiUervnl | 

VU 1 

1 

\’lil , 

IX 

X 1 

XI 

XU 

Ail 

(lornirktia 


1 


\ 

1 



Iramcdkftlo 

ni H 

fiT 0 ' 

n7 3 j 

fih (1 , 

7’l u ! 

7fi 8 

G1 8 

Otic (Iny 

40 n 

fifi 1 ' 

.11 2 j 

fis 8 ! 

.10 3 

71 8 

60 7 

I'oiirlcen (lays. | 

:i7 0 

31 3 ; 

3S « 

■11 2 ; 

•in 7 ' 

ni 3 

42 0 

Tliirly days j 

32 u 

il 1 

33 1 

;i2 i ( 

•10 1 

30 3 

30 4 

One liundrcd days 


2U 4 1 

2i) .1 

.i 1 

;m 0 

33 3 

32 4 

Ih\diiiiii 

! ft? 3 

! i 

1 

1 

7n tj j 




Immtxliftlc 


m w 

72 1 


1 77 n 

1 84.3 

1 73 4 

One day 

, 47 7 

.Vi It 1 

fid i 

.in 3 1 

i 01 1) 

72 0 

.IS 7 

Fourlccii days 

j 10 7 

iii 3 j 

il 0 

in s 

I .10 (i 

10.1 

43,7 

Thirty daya 

' 37 2 1 

37 7 1 

37 1 

jij « * 

1 12 1 ' 

37 0 

3S,3 

Ono hundreil days 

27 3 1 

31 \) j 

.ns u 

3n n 

1 31 1 

\ 

.HI I ; 

33 8 

Arkwright 



1 

i 


{ 



Iiiiinodiiitc 

4:\ 0 

fit) <) 

fit) 3 

17 4 

02 7 

01 8 

11 0 

One day 

, 33 5 

43 4 

, 12 4 i 

U» 7 

.11 2 

03 3 

10 4 

X^ourtoon days 

! ft? n 

24 K 

! 32 il 

.11 '] 

32 3 

32 0 

33 1 

Thirty days 

' 2.1 tt 

27 « 

2fi 1 

a? s 

31 1 

31 3 

30 3 

Ono liiiadrcd days. 

j 2(1 fi 

23 (» 

21 l) 

2s 7 

23 I) 

22 0 

23 4 


‘ Ilalicizcd figures bIiow Reurot Uiul are higher Uuui cclmti; mteival 
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Rccnll mUirvAl 


Immoclialo 
One day 
Fourtoctt days 
Tlurty clays. 

One hundred cUya. 



hundred cases of each group wero then taken to At these fnsiuoiiclos, 
An nttompt was mado to keep Iho number from oacli Rrado appioxi- 
inately tho aamo. 











FaHdnl Mtniorif of Srhfui} ChxHuu OfiO 

The roiich'r hhotiM rml** (lint fhiH iiU'I'hofI iiinkr'j jHiPfuhl^ Um com- 
parjson of difFcrcrit uiff‘r\sik on llu* Iiunih of n pivfii iiinU‘nal even 
though a (hffon-nl tiroiiji ujo*! for »aoli mtorvnl; in ilu' ca«c 
of Miurn we may ennijuin* Ok* n MilfH at (tnaip I or II in jmjnrdjnU' 
memory with (Tronp V in m»’mory /if|orf»iio<lay, Iirnu/i VI in memory 
after fourteen fitiy«, (irotip IV in iiieinory after thirty ilaya, riml (Iroiip 
III in memory after mie iinixlreit «!iiyw The mx groupa an* ujiiioaL 
exactly ahko m leniiH of A^m'oreK in iiniiiediale memory. 

Tho n'BuUa f*ir eaeh muleretl are i»r<‘»ente(l m Ta))lo IX. Tho 
reader sliouhl note r',‘‘|>rei.*iHv Oie rlo‘e rorrenpomlpnco hotwern t)io 
A-scorc column of the jireV'iit lahle with l)ie lawt fiolumii of Table 
VIU. Hueh clofu* c'orre*<|K»iKlriice l»e(.w<H*n Iwti methodfl of annlyaiB 
is an mdicalum of iiie validity of the* iiielhode. 

Taiu.b IX Avnvo.i: Sti.Mmn ♦n* I’lUM.i.ri. <*ii«>urK An-R» DirrKUBNT 



Imkuvam' 




fiiO'ivnl 

Kndimii 1 

CiTmiitm 

' Arkwn'gliC 

I 

I Amenru 

ImiiicdiHlc 

' Ml 0 

117 7 1 

1 50 0 

60 0 

Oiks tiny 

1 ‘U » , 

Ut \ \ 

-17 K ; 

•17 H 

Foiirtcun dinn 

t'. a ' 

.17 7 j 

.'U 0 1 

36 0 

Thirty dayn 

•!l '1 1 

'10 11 I 

20 2 

1 32 •! 

Ono laiiidroil dn>H 

ari i 1 

.12 7 j 

22 •! 

2K 7 


^ Knell avi'fiige m IiiimmI ok one huielred < hh< h, the A'seoroa on (liroo hundred. 


Rate of ForyitlDi/j A eiirvi* of forgollinK may ))0 plotted ciLhor 
from tho data of llie laat- c<d»mri in Tablo VJII or from Uioso of tiio 
Inst column in 'I'ahlo LV. Such a curve would be roprcsentativo of tho 
forgettiiiR of pupila in (tunles VU to XII for tho urticlo "Arkwright^' 
after a Hinglo reading Tim data of Table VIU nro plotted in the 
forgetting curve of Vig !I Tho curve m begun at Bixty-throo per contj 
since this is approMinatoly Ihc amount of tho lest which pupils in these 
grade.s can answer when they are pcnmltod to look up tho answers m 
tho text,—f.c., sixty-threo per cent of the article “gets across” in a 
single reading (hci* supra, paragiiipii entitled, ^Tjomprohension Dif¬ 
ficulty and t'i\ri!l('SHm*H.H”), To enable the reader also to dotermiiio 
how much of wliat arlvmlly “gi'ts acrona” in a single reading is remem¬ 
bered at each of llip intervals, n Hocond acalo is piovidcd to the right of 
tho graph whicli begins the curve at one hundred per cent. Tho 
asymptote drawn in lopresmta tho calimatod point of complete for¬ 
getting for the matonnl, which is taken at six per cent since it was 
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Thf Jtnifunl mj J'>iur^ilumnl 


fouinl lh«( pufiil^ fotjM (in*'U*r(tn^ jiiinuinf ff tlx* tth( withuut pre¬ 
viously liiuiiiK n'utl tlK^ urln'Ji' if*'*' , [jarjiyrapli oulillcil "I’revi- 

dim 

S«uiiu5in?.iiu' u!ul uitcijtrt ^uiK Uu’ O-iOi pn‘■fiifi-il, \U' ihal 
pupils iu {\w •! art- hMi- Uiau'-vstTuii u\4T!iK<Mvf histy-OwD 

j-H'r mil t«f liio rpii-'-lutiiH uu ArVwnwUl vsIm'M U»‘\y urv lu'iinillrd lo 
look up llii’ J^Il^u^Th uj Uu' nrtii'l'*. llril mmu'iluiirly nflt-r the muViii}; 
ihoy n’lm'Nilu'r ;iu uirr-itto nf ."lO 7 piT «i !»3 un avcruncof 

48.0 par (•i‘hl, jjfirr Oiurn-i ti an of .'Jii 0 piT cent, nfler 



* »\ 





tv 


<<y 


Vio, 3 


« «;V^AP n 4i} }\f OJ 

Ooj » 

-Avorflgo lorKOUlni! ftirvo lor Arkwriftlil Ihihm) od X-Ju nroM oj nil Rroujia pnr- 
tlcljM4.ll«K (u iKo <*s;jtejmkOttl« 


thirty days an average of 82 *1 per cent; niu! after ono luiiuliotl (lays nn 
average of 30.0 per cent. 3’hr iminediah* niemory score nipro.scMits nn 
average loss of 43.3 per cent of th(‘ fiuitH (in'si'ulcii in tlie nrlielc iciul; 
of this, the difference betweeti one hundred per cent and HKty-llirce, 
or thirty-seven per cent, iacluv to ftuUur (o etiinprelieii<l and to ome!e.s3 
working hahits, and the remainder, U.3 iier cent, to fargetliag <luriiig 
the interval of reading the article and taking llie U'sl. U wc com¬ 
pute tho per coni tomomliorod of tliat winch noLnidly “gela across,'' 
wc obtain scores as follows: Iiiiiiicdiiilo iiienuiry DlkO per cent, ineinory 
after ono clay 70.2 per cent, memory after fourteen days 59 3 per cent, 
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memory after (liiriy .11 V nfrceni, mui iiieiiuiry ufier one hundred 
days 47.0 per rent. 

Wc find Imrr' the Kune piiMeifilr di‘*t'o\eiT'd hy KI)lnnKhauH,--m 0 ., 
that in fnrKetlnrK h « r«|»id iiiiftnl he's and n rtior(‘ gradual 

aiibwiuent We hn<i »lw» ll»e {>iiriei|p|e eorjelierafed (}inl mean- 
ingfalfnalenal is fowdfen |e Hfpjiekh' Mifir? non^{‘n‘-e ayllaldea; and w* 
may add tlnd fuels learned id ikeuigle le idmK of an nrlieleof thedj/R- 
culty of ArknriKld an*, »u the |ori|.(er iiilervals at least, for^oUen lef^.s 
rapidly Ilian m nieaniniifnl inateriid in I lie form of poelryJearned to tho 
degree of one eoneet ant) uidn‘H||*ii]ii^ reeilal. In Table X we jne.sent 
data taken from three elassip atupbeH nf /nr^reUmg’ and compuro them 
ivith our resultH A study »if the lulde elinwh that the nuiounls for¬ 
gotten of wlmt »H ucl ually iipjireliended nf Arkwrif^ld. are less, in j^oncrab 
tlmn for llie other imUeiuilH, es)K*<*iaU> nfler mtervala of more than one 
(lay. Troni llie jimllmn of tin* aHyiiijitnle in Imj; it la alho apparent 
that the point of eoinph'te ror>;e((inK m hIiU far off oven after ono 
hundred daya, and, from the nhiipe of the rurve^ that it would take a 
long tune to reaeli tlnn poiiu, if ii weie ever renelicd. 

Taiii.k X Mf,«oiir Amn DiwairAT J«TKavAi.fl 
Conipnriaen (tf IIi-huIIh of 1'lilntiKlxiUHf lUditHnaHlp'MitAr-li and Fiiikt'nlandcr witli 

I’ri'St'iit Slntl) 



Nonw^iiHO flylliitilcfl i 

j Poetry ' 

Ffictunl 

InliTVid 

! Klitnng- 

hauN 

IladoB' j 

HAWl)P- ' 

wilauh i 

Kitik.cn-1 
biticlrr 1 

llndoB- 

flawljc- 

wilsoh 

Diotze 

Immcdialo (20 mmulcH) j 


80 

’ 23* 

■i 

00 

O/io day 

! 31 ! 

' (iN 

1 .18 


70 

FourU'cn da\H 

22' 

11 

■17* 

HI 

50 

Thirty dayit 

; 

i 20 

11* 

■■ 

52 

Ono humirod davH j 

1 / i 

1 P 

3S* 

? 

48 


* by iator{«)!«timi la n«th(»r'« laltlri 

* by t'nlry in I’lnkonlmidorH tnlileH of 10 Ixig 

' J^lth/iiKliauH, If {/(lirr flan (irflarchtfut. LciptOK, tmoslrtlcd ))y II A 
Huger and 10 lli)«s»'mna, Mnmri/ Burenii of Vii1»1whIu)iih, Tcaclicie CoUego, 
Columlna Univt-rmlv, Now Yoik, lllllJ. 

Ila(l()Hsiiwl)(‘\\il»('li, P H, lin't Fmhrbrexivn ile» Vcrgesaeii'i viU dor Zeil 
Hnick dor DioU'ni'li'Hi'hrn Uiuvormliiol, Huclidiiiokiaci, Ci'oottingcii, 1906. 

Finkent)iii(l(‘r, 10 0 Tito Otirvo of KotRclling. Amcncan Journal of Psy¬ 
chology, Yal XXIY, torn, pp 8-32. 
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Tht^ cfinrluM^in w rmf!;*-*! «»i* 0*<' «»( »U»* uU»\.«* juinlysis, that 

(n) for^rHu)|5. »»< r*'vl ;i Uhjt' VliOBamc 

ften^'ral luw (tf iu»ii t! ItT'i rtn^i iu«*rr»yii'i/iu i| Mil>Hvq\ir'Ut 

fowwi l)y i\\\v'r i4^*rn f*»r iM'iU'irv, O,') fMrR<-!f ihr n( faci\ja\ 

mtHprinl jirncwln tlowlv «1iiU nf ihuivcuw Hyllablw, 

(r) fcirgrtUMK of furtiril m,t**'ri«l |ir«*r4 * »im»ro ‘•ImwIv Umn forj^ctting 

of Hicaniiiftful uuiiiTinl «l l*v r**!^*, fm»l ‘^h it t'tkc'^ niurli lunger lo 
apprnxiinalr' n iKunl of romjtUt^' i^r fjsctunl inalcnnl (lianit 

rioM cithfr fnr nonfM'jiH4» «»r iiirMninKftil iirilrrial loarnrd by 

ToU‘. It fihouM Ik* r^-mnnlK^ri'*! Ihni iIm* nlmvo coniimnsouB arc 
bctWM'n memory fr»r m a ‘'JukIo ri'mlingof nn article 

fl8 mPnauirrl by n rrcojcnilioii mul >vrln4futi ineinory for matcnnla 

loamod by mlr Ift !l»i‘ |>oiiil of om* jH-rfrel and nnhosUafing 
repitKluclion. 

(’oiuinmrovH n^n\^^s: Mrut^iiv lMKnv\i^ 

/n/roriMf/troi ■ Tin' proldfiM of fori;<'(iin^ oill l»i' jilill further 
clarifif'd by na iiniilyHiH of fhi* relriiiouhliip iH-lNvocn Ibp acores 

of UiP wmm individuals nfUT iIifTmuit iubTiub, < <', of ilm (luryliou, 
“Do piipila rnnk in the Harno <»r«lor, in mciiifuy jiftfi dilTpa'nt lime 
intervals?'* This can be doin* mkhI r\|M*iliijoUHly by thr; correlation 
motliod. 

Bovoral workers have iuvratiKabal tlm corndalioii beluccn niiinecli- 
ato and delayed memory'. Aiiioiik (Iii'M', 'rioirndiko found a correk- 
Uon of ,9 between iminedlale roeidl for livoUa* micimiii'clcd words and 
delayed recall after tweiiiy-four lunirK.* (into/, fiuuul coirclnlioaa 
of .73 io .89 between imineiliule and di*lay<*tl n-caU of noosi'nsc syl- 
lablea and of biogTapldea. Hw mibjeelH wort* cbiblron m the elemen¬ 
tary Bchool.* Bufisett rc^mrla tiverana corrclulnairt of .S3K between 
immediate recall of hialory coumra ami ri'ouU after bmr numllw, .797 
betwcon. immediate recall ancl reciiU ttftiu einbt numtUh, H30 between 
immediate recall and rccall ftfU‘r twelve immiliK, K 1(1 between iimnedi- 
ato recall and recall after nixlcen iiuiulb*), .Ikiri laUweeu reeall after 
four and eight montlia, .015 betweeu reeull after eigld. and twelve 
montha, and .001 between r(‘eun after hvelvo iind Hi\b‘(*n inonllis, 

^Thonuliko, E, b.; Tho IlelaUon bt'lwinni Moiimry (or NVordu imd Meiaory (or 
Nuinl)orfl| and the llolation between Mciuury (iv«*r HliorL aucl Memory ovorlx^iig 
IntorvalH, Awericna/oura/il o/P«j/cAo%y, V«l. XXI, UHIl. pji '1S7 IHS 

*Gatcfl, A. I: Correlftlion« of linmedinio and Doluved lleeall. JournuioJ 
Bicpenwcnad Pmhologu, Vol IX, 1018, pp. 4H0-iUU 
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She concludofl tlml liiiu’ fnrRi'HiiiR cln noi proaily mhivo iho 
relfttivofltandiii^ of pupilh ii» nMnilimi of hintory loiinied in Rahool,‘ 

Tho corrrlatjonff fddaHH’d )>)’ M»»’ nuIhotiH op'ul an*, in 
fairly higl^* Indood, Tliormlikn iniik«‘H fho «lnU*mPnl, “Tho relation 


Tablb XI Mryonr ArrrAi Vahioit^ 

Inti uvai k 





1 

r rorrerted 


r, \’nnfii»h K 

r 

VK 

for 


1 

i 

i 

j ' 

ntloiiuntion 

L ^. 

1 

Immediate lladiiirn; mo' d«y (»crn»«t»rt 

y.-i 

017 ! 

1 Nfj 

203 

Iramcdmto ticrmniis; niii' ilnv .\rkwriRlii \ 

7 H 

inn 

83 

284 

ImmcdmU) ArkwriRlU; otii* dnv lUiliimi j 

72 i 

! 019 1 

■ sn ; 

280 

Average: Itniniylinle; niKMlftv 

7 r» 

\ 

i 83 


Imincdialo HAdinm; foiirU'Mi (ln^s (ierinnnn ' 

01 

020 ■ 

00 

273 

Immediato Oermnns; fouriiiTi JuMi Ark^riglil | 

50 

030 

1 51 

280 

Immediate Arkwriglit; fniirlii'ii days i 

53 

029 ' 

58 ' 

282 

Average. Imnicdirtle; fonrCrcn dnyK 

5.5 

1 

' 50 


Immediate Hadmin; lliirtv dii^a Arkwrixlit 

48 

032 

1 r >3 

258 

Immediate (icrnmiin; thirty (tn>s lladiuin 

50 

030 

64 

288 

Immediate Arkwright; . 1(1 days ('icrnmiis 

1 6 H 

030 

! 02 

226 

Avorago; Iniinediale; Uiirlv dn.vs 1 

.52 j 


60 


Immediate lladiuni; one Inindrivl dnys Arkn right 

' 30 j 

030 

30 

223 

Immediate ClrrmnnH; oita hiindrpil ileya Unciiutn 
Immediate Arkwright; ime tniiulmf dnya CJer- 

48 1 

032 

52 

201 

mans 

m \ 

030 

64 

204 

Average; Inimedmlc; one lumdrpil days ' 

' 45 ! 


48 


Fourteen days lUdmni; linrty dnys norniArm j 

i 58 

032 


102 

Fourlcon days (Icsrinana; Ihirty daya Arkwright | 

58 

030 


228 

Fourteen days Arkwright; (liirly diiys liAdium | 

50 1 

033 


241 

Average! fourteen dnya; thirty days 

55 




One day Kadniin; ono hundred days Germans I 

33 ' 

050 


X16 

Ono day Ocrniaiis; ono hundred days Arkwright; 

33 

002 


03 

One day Arkwright; one liundrcd dnya lladium | 

38 

053 


110 

Average; eiio dny; one liiimlrcd days 1 

35 

i 

1 



between rotciiUon of the effools of an experience for ono or two minutes 
and tlicir retention for ono or two dayn lluiH seems to bo ono of tho 
closest yet miMiHured in Iminan jiaturo.'* However, wo must romem- 

* Dflflscll, 8. ./ . "Itdlorilion of History in tho Sixth, Sovontli nntl Eighth 
Grades with Bpocial Koforonoc to tho I'nctortf That riifhiciico Rotoivtion " Johns 
Hopkins SludicH m I'klucation No. 12 TIio Johns rfopkins Press, Baltimore, 
1928, pp. 22-24. 
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KFKKC'r OF OFiOKll OF 1‘UKSKN'rATION ON I’lIK 
UOt'AU, OF FKTrUKS 

lUNII i. I» IHHHIA 

vt« 

IlfMilts ill Trilx'*! Hi ihiK rrjMiri wrn* itliifiincii ni rnnin'otioii with 
fin cxjKTmM'tii nil ill'* • Ih H of 11111114*11 iiitHriiiuiioM on iiioniiiry for 
picliirt'.s’ Hill* lniioir>'ri fwi'iiiv •'lutli'iits Hifoiuinii; llii* T'niv<*rHity 
of wi'H* fur MilijrrtH I'ttr ini'iiiory mn-tonal Iwonty 

uncolorril jiui-lriinl iiirlun nf painUii)^^ iii flu* CliicsiKO Art InHliluto 
were tlimiiKJif'Uf o’*fn|luviM 

I A \^toii'ii5 HI h' VOlhiito nrjf 11, lN7H- (U) 

‘2 ’rill' Iitijuljiiii, h. .T-'hii %’^TiriiMil, Anu'riifiJi, 1112/) (1(1) 

;i Ilf Ati' n» 111 *- i.f ('Piiiiifi, l.y hfnnruM' Iknilct Di* Mfinvplj 

Krmrli, l*iM n**f 

4 AmI* K‘lUl^^ Ia' A‘h<l|*Ji Sl.TiS'r. luriMnn, is'iH IMty (20) 
ft 'I 111* Mijn.i'(/"* •"M, hx < M lanl'!'»rlw rg, IhilO}, liil7 H»J0 (ID) 
a, Till* YmiHR H»'l, N^.U'h, IS20 l'M?2 (10) 

7. i'i 1^” iN“»*M}i if M<01niii|, l»^ ]'itKui< .lilivl, AiiNlnnn lR3fi- 

iOUl Ift) 

h '1 III" I'lilfll'i Ilnf .* 11*. )«*i liMilitij/Komiw, fii riiiiui, 1S2I) 1010 (llfi) 

(I, IW'inurni'i*'. *1 ),«' I r, l*y |*'* Hilii rii, lOSH ll)r»ll (17) 

10 I'nrSniH ♦*( I.v Vdn Duk, Mi'imnU, UiOO Kill 

m 

II lOiolir Oi'U B Itv Ui itikiAiiiii JIntfiHiiM' Viiii llijti, inOO- 

1000 (2 0 ) 

12 'llic IVri-'ll'f'« f'k ill* Jiy'*, Ia Milmly Mi)iikni''\, IliiiiKuntin, IKIIl'lOOO. 

(U M 

I’f NirIiI mi I!*’ I.-xj'Imi nf Kitl'innu**, Ia (Viiimi’li, (Ipniinii, M72- 

10. W (V) 

n A \Vr ii.«k'(i.-i I’lT-l'.. I.v I'i Misi.l (-*1. IHkhmi. m22 1000 (1) 

III TIm' A''’i'ii|Ai<-u I'f i)>i' Ia iiiKim *rii<o(<)kfi|iiiiiIiiH, S|KiniKl>, 

i:.l7 lllH (-ii 

10 'llii' Ifi'j.i " Mf ^)JM' M r» !»r. Ia Inn (’Imiln (’iizni, I miL’li, 1811- 
l'«)l (0) 

17. I’iIhI*', I'h'iIh 1*. 1.“’ , .Sp’Mii, l*\ I T'Mik W MranKivvn, Mnalmlii 

lMi7' (l,li 

IH ]|i> 'Out It \hiliiMi Sill Aiiiiiut.' Vnu, I'V lli'iijiiiiiiii Wnl, Aiiii'iicFiii, 

11. fS Ih.MI ('ll 

lO 'Oil* Wiidi .Mill, l<v MmiiiIiiI IlMlilii'iim, DmIi'Ii, 102^ 1701) (8) 

'20 hi UmII u.'I U 'O' I", Ia !\im1 h in I’lmilt 11 ('la*,a, Ki'Ikiiiii, 1.811) 11)00 (2 ,'i) 

M) I) DmiIm KOi'i i*f rfiiiOiI liiforiiiiit>''U on Mfiiiory for Piclures 
jVu'^fKin AV ' .’8« jit . I'li'k lft'li«iW«, Xi» 01, 10(0 
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a7H 


r,ifh jiiir'»in* ioj i . ',T<\ 'jn>t ^ 3 '' inff»Tni«lioo 

jH'r» 7 iiii!nK, »*« Jtj«' -f nr l-u ihp 

hkIjS i*f tls-" jiirhjji* svf^< f v>» p- n r,| r-JiiKingfrom 

TUI init*rmH^n«n ***> ksj nxf^5>5i^iv Ui« ■'silc ».f tht' ptriuf^i^ 

!lu' In-^l ijritiir* cf •'ll*' f, 'tsi'l s }»'* J.rr fh'‘ 

'riiif'pir^'ir>ff'h'i'sluJuSs’srv 'uS'jf< f. 

Ui»f n •’> r*'V< 4 '> U>i * \* is bsjsui‘<ii'Ui ly nli llir* 

|}icitiT<‘^* SM h', j>r< r-* ij’f il ?}{<’ ■.'v I" fu t|t vnln* PH it wpa- 

mlA' c'ml nil tht' jnrhir* h'* « aM"' ?-i f 'i s-irii! v Mi)*)('rU were 
ui '^‘4 fpT I nvh i<f M'S s fvu»hu» i =i*.ii> 5 i 

Fur <)ip r(?-<i5<“h Up* ««r‘l‘’r pf pr< h riiaU'iji and 

fnMjiiciicy *-f ri'i'jiH iv^n j». ‘wsap >1 I’li*' IiP'I' ssn-. itn* rank 
ctxrri’luUuH mi‘llm'! IFiic**. we T^'ure I ilu' liunU'ir <d (\m‘‘s n 
pirliin' sv»^ rrrjiJlr'il J*\’ Ue* pjo* h^j»i“llr»-i iweiiSs’ Mjhjerlp Tlip 
pirUiH'H vs* re ilu'h trUik*'<l mi r)H' pf Uu uf recall 

'riie mij’ii rer-illnj pjf<up‘ wij*i jnji hr^l, »Ii«* rii-xi uiuH 

fwjiieiilly h'nii irjlM’ml w.p ji>i« ?!.•' fihil oji (rank 

riurnln'fH r»f ri'call njv bispo hi ilje p it« hUi' Oh .-Wt-r < ir]i |iirnirc in 
lh(* liHi|, ’I hr' Milk rorr* IiUpm th» fr* ppi> lu s uf nr’all iinil 

the onitT oi prew'iiHiitmii ««« hjtinrl I'l!«“ *U ’I'lii** iii\»‘ forre- 
latKin Ifiirla In j-how iJul tin- i ftrlpr .1 piriHrp* hp pr» ^''MHeil Up’ IfS'W 
Itkrly U Will 1 ^‘ rfc.iDeil 

Tlip i*<*rpinl Muilnnl iiN‘^1 w'fif* iln* |/rfiphu' ini'Jhpi.l 'Up* ivii-iiiy 
picUm'M were ihviilni mipn hsti prp<Hi‘t«‘ 'Hh* h jnrtiiiriM )*r3’‘’enu>d 
firat mill Ihi' «11 pirliirf^t pren^ nP'ii M'l'uipi, I he (isi rip,! '• «*f ilu' mnii' 
her of pielijn*» riTHlh-ii iiuiler 1 ueli nf Up- j*j\ < 'iimIHihiih iiifornnsltini 
ssttft cnlcululPtl. 'rlu‘M‘ nvi'ra^i"!, tuKp'ilp'r v»ith tip' tniul pvit iki fur 
all lh(‘ oiit> IiiMiilrr'iI tueiity aiili]i svi n' tnlMil t'* 'I in ‘f aid' 1 


't'AIlD i 


I’p inn s 

1 

1 

II 

in 

IV 

\ 

\ I 

* 'rill’ll 

< 1 . iMraHiai, : 

Vi u 

V t i 

\i i 

n i i 

m w 

11 a 

] 11 

b. Ki*roMd u>ii , 

l.'p u 

IV* 1 ; 

HP 

U H 1 

i-i 11 

ir, 1 

M « 

Hiil»j(*eu 

' w 

' UH 

' -la 

■ja 

' ;a 

.:a 

,1’jii 


Umlvr oivoU tnnuluhm of nifnrnmtpm, ilti*iKii:ileil liv Uomivn 
miinborH from J tu VI, a IukIpt nveniKi* was fmiiiil f«ir tin* m-cihuI liall 
of Iho Horif'H of piclurt-n 'Dn* ihrri'reip'p iM-fwirpi iln* ippfal uvit'IKW 
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for {»il till' Inni'lff') fw«'nly m i^lnrh ?» rorifinimlton 

of tlu- nlnivi' fin'hnR Hut ■ jih'M. hi Hk* iiiilf of lli(» 

ponofi vi*'n’ r<ril!r''l f}M|ui),ily, »»h tli^ u%»r;iKt*, lltcn pictnirc’w 
prcdcnl^'fi in ili<' iin~’ f>f ili*' •w^rif'f 

Fifpm* 1 unspljiffOlY T* j»i» itif Jl4< Ni.* HVrrHH* plnlP''! 
amriiinl nf nifcrhiwhrm t nr\i' .1 On* hrM U'W piclurcK rind 



mv»‘ /j ilu* HTiiiid U*i» piflun-H, 'I'lin dilTcronco liotwi’cii Iho Uvo 
curvrs iH n’luiily hcimi . b ik iminli )i)K)i**r in nil condilionH than ourvo a 
T1\ik moiiiiN UiiiL piotun‘s loout^u! in Uu* mwind linlf of Lho Honoa wore 
conmKlcnlly h'oiilliMl mori* limps Umn Ukwp m tlm finit. half of the 
Borifw 





6H<i 

Ihr I ♦Jn-ult’tl into iwo 

tH\vi'i\ jin!*Kr'^ns%r^ f“» ii ‘ic nf h\<* ptclutta 

rar3j. r^jj<ij|nr5v, lh<' .»’k» i*- *'■»^ f ;idi }?roiip 

Ilivkr • irh n*i4'h5i‘'JN ^i^n^^'^'’< i ai ;** n 



The lolttl iwemK<‘» (or nW U«* oim' iiumirfil iwi lUy inih)**vtt' nr*' 
also jnoUidod in Ok* tahh*. Acrunlinn l<» iho lotnl ovituki’^ (itic ill'll 
ooiumft) pieturcain Vhe OnrdiiunrliT ww ri*ndh'»i ihr (rvtutcullv. 
Pioturos located in llu* laai qimrlor comt* llie •w-eoinl Knaip the 
next, and the firwt Krow)) in the laat u( ail. 



p</ /'jtf ly/ft 


ftHl 


phnwn lu Ta? ?* H in l-ig. Tlsn Inghf*st 

cur\<' If* nirvr / Kppni'ji.ii ilnr-iJ uroup *4 piotun't wliicli 
indicwK^** ll(nt Wp*-. |V'«}!5''n ir (he ipinrl^'r Ui nil ('■JErppl ihr* 
first /iHfl iiflh lu ill* Mh* r onnlilirni it i« rtpinl 

willi Llir* I'if't fpirsil^T, • nT'-.*' -I ri pn''■'riliiiR llii» (pjjirltT 
down f’f'iKfiJillj iH ll)f' ntrdiMrn runtiifirtnp. (‘nrvi* h n'prrw’iiiinp, 
llic wr-ond ipnrPT it 4s!f?» r» nS (pitu ih** hvn fpfwcirillv under 
the end miulUihitH 


'i'-up'is II 


IV' l'^l•rn 

1 

' u 

HI 

IV 


VI 

; Toui 

0 Kiratfisi' 

II 0 

\ i 0 

n •< 

11 n 

h n 

in a 

10 8 

fc. for 

M « 

H a 

1 1 ri 

1 I't n 

I'd (1 

Id >1 

12 fl 

c. Thud hvf* 

1.'. J 

r; 2 

in n 

l.'i 0 

Id 0 

l.'i n 

; u> 2 

d, Pruirlh fitr 

\r, i 

17 a 

M tl , 

Kt (1 

Id n 

11 I] 

; 1 t 0 



yu 

;mi 

Uil , 

do ; 

! do 

ido 


Picliirrs Inml'Ml m iln« hrel ipmrPT ninl ^ynibnlDn'd by curve u wore 
dccirfiMfly IeH.i« (rM|ur*n(ly rec'illr'd (hnii pirluren plftccd In the other 
three qmirU re Tbnt (nei m etr-nrly I'Viih nt frimi tlio ligim^. 

An tuldiluiiijil bivt niny lutP'd froni bulb ft^nreii winch ih not 
Htnctly ndub'd pi inir prubh'iii 'f’he relutinn of (ho amount of 
infonmiiu'ii and frerjUMiey of naim'dmta rccuH m coUHinKMit foi 
all (lie grmipi? nf iiirlnre'c the Indvea and tin* (piarUTH. All curvcK 
first riw* (d ilid f<*‘(on<( fdiidiiian, (hen (hey (Irop down to the 
fifth cnndition, and again fur tin* M\th comlUion. Tlie meaninR 
of dim relatinn wmh tinltslaiilialed in a wparate ailiele,* However, 
the co/iMstenee of (In* relation m Ih'iok nicntioned lieio for the 
Qrat lime 

'Idle follouiiiu ('niK’hmioiin may be drawn from (bia exponmenL. 
b TJje ranh e»>rn'la(n>ii bi-lween t)»e order of prew'Jitudon and tlie 
frcipieney «if iininediate leeail n'cmih to iinlieule that priority of 
prchenialion i» not eoinlneive t<i nueli recall 

2, In all till' MX cundif lojjH of infojnmlion the jiOHition of a jacUire 
in die w’l'ond liulf »»f the M'rie‘< m iiior** favoiable to iniimsdiale recall 
than in the (irat half 


'Ibtii 




TIIK INFM’KNC K OF AX Ari)n*)X(‘K UFON IlKCALL 


HPUHl 


I mvrrfiUv of 


Tim, I'ijuju.j m 

Iniro>iM‘rHNr r^pnrK^ fnun nniny t>lv«rvrn< itulioiUc (Itul llin pioR- 
piicc of nfi fiuilli’iiri' frrijii* jiily h‘l^ n (l»‘lriiiir*i>tfil ofTorl. upon porforni- 
anw'. Mony hhIiviHmoIk Ihai llic* |ir<‘M‘iicf‘ of f>lljorfl causoH 

thorn ninny <lilln-ulh' ^ of Iwlmvior rhinTiuHy in wpcooli ami mnoinonio 

rOflIionfif'H. 

Snincium ** vm' hml flint n nlmlont ronir.s lo hchool, hooiinngly 
uuproparoil, yl lu* mnininim ^ rlmi 'Mlf »li«l loam Inn Icason, but 
that ho rojild not ffimoolMT wlo'ij »»l)irra uoro vvoIoIjmjk." Kvory 
lojichor H fannlMir \Mt)i tin. or niinilnr >'laicmi'jil4 anil ho frof|iipjilly 
conHiiIorn i( na a iioti* om fur not hiivmy; hIuiIkmI. TIiih invostiKU- 
non iH nil atioiiipi in •'luily oxiM-rmn'iitully hoiho of (ho fundumcivtnl 
phnw^s of lln’ hIhim* prulilnn. Miir ta^k in tn dincovor wbotlu'r an 
incltvidiml svIiM h'i*< h irio'it (mtIhui nii'innry inaloriul, aiul ih than 
rofjUiroil In roonll tliiii inntiTia) lH>fon‘ a Kxnip nf puoploj nviII an ii 
ronw'nuonro nf llu- pn nf lli.K ntnlioni’o, Iw* ulilc lo recall aa 
readily a‘4 when Im \n alnm* 

Tow hnvn rnn*<nli red (ho iidbioiioo of a ^ronp on an indi- 

viduid'n idnoioiioy In reiidl ulnoi lonrniriK did not lake plaoa in tliat 
(troup IJKini‘' in tho niily author who n>por(R any dulii noncorning 
urouj) mduonri' on n ndl nr rvprodm'linn Ho ropoilH (liut inoinory 
is hoUor 111 lln‘ Knnip I'nrly olnldron wore nivon one prohoiitation of 
a Horioh of ono'Hvll'iblo wurd‘v ami won* Ihon oallod iijion for a written 
roproduolion iioimMlmtvly aflor iho proH-nlalion, and unotliei one 
day later Tir.^t, ilu* imbvidiiaK wool Uirmmh (ho aimvo alalod pio> 
coduro alone, ami later as iiioiiibers of u ^loup Klkiiio explains ins 
10,sails ni lorins of "rivalry ami iho mdm'noo of auKt!:OHlil)ilil.y duo to 
ooiitaot and iiier*' prcKenoo nf nllioi people '* l-dkino's study diiTors 
from the one repmleii in dim p'ip(‘r in oiii* nnpnrlanl asrieol Ho 
Kfudied (ho niduenn- «d a p.niiip un loiuniMK and monioiy when (ho 
snbjool was ii iiieinlsn of the Kioiip The lesulls oblainod may lln'ro- 
foro Im* eNplaineil as l»eini4 duo (o nvaliy In tliiH slndy piirlioular 

’ I'llUni*. 1 '‘ lalhu itM* d< nuaiii hur I'l niininin* J i/e 1027 , ppj 



Th* J'H 7 ,/J? »>/ yj f/y 

carp Hakrii Imh hinun**% ji’* j • "ol']*, ?)’•' i p 'nr <«f i JiiujwliUon, 
and lir'i|p7' »lf vm-p* s^ * illii-y; Ki fi»p‘ |k'u|iIc who 

vvrrp nnt iii any r nsujt’jr }»< ''r»i^'v 

Ml tH'»h v'‘H I’lt'*' I ni 

SiXiy mtn n\\*{ -«»>»«• v.(u»rn, 

fttnii IKp >n uiJrniJjir’ifijy v, .lud finm tlojiari* 

tjf llip riii\i r#'i».v iMisarij il mi »hn i xjffnrurni 

iIixmIpiI ftt rari<I«nii min ilirro 
grou^M Ilf Iwr'iily raHi tJmuji pim* rnnjrnl, fijirnmji and 

fijcallitig Miuli‘r lliT* iinnipd mndiiinn, >m»Ji miIv th»< PXiKTiiur'iiter 
prcwnL Cmnip tx'p liariivd mpf*-? Mjp I'Mip' in(pli<Moi ilnl grouj) 
ODC> hut Ihc-y rccallrd ripI rfl'Mrinnl «ij nurln iirp romuHiniR of 

four i>pr*ionR nlin ^'n* in Mip rxirttMi.'iii il rtrnm v-nfljmit any 

nltrnliou (n iIutu TIip iiMlividmlf pf timnj* ihn i* silwi Ir,iriif'<l nlnnp, 
and tluMi rc'cniird and nlpnnird »« nmlimi'p ’I'lim nudir'iicc 

howcvor alU'iilivrly naiHir-d and Ki |i5 irarV nf r« 

/liidt€»irrfl, Tha midipun k «d ivi»» i»»< u am! t\s(i v,inm*n, 

all grailuiilx' hUulonlfl nr nminrs i« j»HYrUnlnK>*. 'J'luy xM'n* ndiTlod 
with ft vif*w lo Oiidr pirMiR** in iln‘ py* K Mn- and «t< fur im 

poi^ddn ciinKn<trd of fKaijdi* wlm wr-r** uni anpi iMiiid «iih the hiiI)- 
jccl«. Kii nUpmpL mw nmdr* Im ln»-|i ilm «>!*mp 11^)^11111111*1 for 
iftlorH llimUKlKHit Ou* Ah liafi jdrvadv Ihh m 

two kmda uf nudU'nrpH vrin^ tim* m v.lmd> Un- miiuUm 

paid no Aticntum tu Ihc Hulip-rt, Imi w*-rp iitfndv pnm m tin* ■ \|arl* 
montnl rooni: Another, an fti(pii»i\i* midn'iMM*. tin* m«sMln'rii uf wliicli 
lifiloncd to tliR Ruhjerl and rheeked Itm nn n *i|i|i of |i:i]R'r 

which ooiilflincd the IihIm of wordn lu tin ir i'',rr» 1 1 onl*-r 

Afni-cnal. The lualeruil lo Im* Ic&riM'i] i'oi(*«]Ht<'d of a h'-t of lifu cii 
paira of wcmls which hud lm*n Hdoriod ul random from u nmndurd 
dictionary, lu conslruetiuK thi* h^^ eurp w.ik lakon that un h-thT 
should occur twice in a pair 'I’hi* isord** wi‘p* oniio »*ii hy tm';ins 
of a Imnd-oiwralod iiifMiiory driiiii, « fi'iiitiurd jmirumcni m tlif 
liiboriUory of the Uniso‘r»iiy of (’hleaun ‘Ulii r iinUTiuK um’iI wero 
curds three lo fivii ineliea wUh ihr* rcHiMiui+t* word * I’oini'd i»n imorrO’ 
BpondiuK order with theslimiiUiu wordunf ilm leil for n'rordiuji 
Iho rosponHCs. A aUipwaieh «*rved (or luuuu^ tUo espoimre of llus 
paired assuciulos, 

Procedure. The paired iiWKiriuU* IimI wu*« pp.^vniid oner, allowiUK 
throe seconds for ench exposuri’, afler wliieh ihr Huhii rt vwts (i‘t<ied for 



llr J r. A'. 




aKfi 


fccall. pt'j.re I^’J ^ 7,W,»,? J,fv 4j,r 'J J5(nrl 

in a ^ '''• ^* ** ■ 'i, aTs>c( sho' 

KJ'*< Ml* ^’T- ;•* r a** -I'' ' »' '>*»‘^«?} t^K' yr*«''T9 tun<‘ r»f 

{hry’^’#^T') 3 }'i^ ’J i .B f 1 }'j'* J'?< * iI.Hj »l ' p" r<*Ti 1 ?l 3 i 7 f*>J 5 »!i 5 ji Ok'’/^ ul'jrr! 
KBfl bM<' ’'I "^1''^ ' ’Jv 'iu * V' TV ' 5 !''<r 4 5 !; hfA Thr* 

cril'’n‘«rj <4 ^ r}Tn>i4ii ^ f' *’■ »»f>J| A pul^jrrl IrMrii'nl 

thp Itf** -..»‘ft.<-i5 »** t Jfj'i atj<l ril'HirnifMJ ihi’lTi 

j,m'nl)‘J'tsjr hi* a •3‘'5 «‘t’ i i’tjf ?Jf** nr ifi 

'!*> n'l'L* 5^', A'"‘" M sa*•}*'«-*MjKtn thf* 

particular cninfiCii*^ ‘{< <1 

Itisilru'fi ’?■* i,Nrj?,'j»jj*'i.f ricJt pnljj'^rl w/n 

n?qulr>^l Jn n ij"J a i>sfirAjn\ ajnl UHinicJinri 

shi'cJ, fi/8«’r vihtrJj f,t w ,«■ >|\STSS4.} in in'sli*" rcrJuin that h« 

undcrMfMuI rti«'j,'o,. 111 ii j"<i?i> ^^ tlip ^!5hi^* ilim* he wn^ 

alfti l«ihl uiuh'r w*h ii roinii";**}! h«‘ ■« ib, »li Ui jrr rtl, Jiinl n'lrarn 
on iho fnllntt'inp, <1 ty '1 hn^ r r> !■< f««rn h»’ pUirderl 1 o 

learn, ishi'llu r nn aufS^Jn-, aini if r»s whil Kuul of an funiinict), wft« 
to Im? prr^ ni fur r* < ^IS 

The only wuh;* t •?? jsn# n »»Mrnr!Miji« mi tin' rt'i'oll ilny wore 
ihft^ whtt \n Tt’ Uf iAH' an tfiHrf «thr ‘JVj do-in, i)ic» re^niept 

iiuuh* to "naiHJJi’i «ii«''jh»'!y nnif lomlly. hi dm! every ikthoii 
in die rofnn r.in un<h rM-md ” "Ih^r* i Mtj* onli r wjia Kisen U» enlninee 
iheefrcctivtmftrf^ i.f do rti< iitm'nijitnuro rno) tilin' l»i furdior inmuMi 
the fliffericur'' Im !w« > n do* lonoiid^miM* and nlu iid\o lUMlIonee. 

7’r<'/ifm<'rif tif IhiUi, ’Hio aiionnit of n<(oht(?iit ih Hind d iii teniiH of 
(1) minilMT of Viorda r»'olIi'*l« r«i iiuml<«Tof 1rml« ref|mr»Ml to relearn; 
and (.'d the pavnm re-iro, «hirh vviiMohl'iiijed liy the ^fdlo\viJl^^ forimiln; 


1 


( TnaK i*i 
T'n'tW to loMni J 


The (lifTerenre lu efln-ienev of rerull lH‘lueen the W!V*'ral ('oiidilifinR is 
detennini'd atruiednlly and t!ie reenlla are wialed in terms of lim 
numcricfil tlifh'r<’hH *«, ilio uMrnK* s, dn‘ jirohsibh' errora of llie means, 
die (lifferi'nee 1 w?h<»7i the nieMiw, iiml llie prolmhle mror of ihcjr 
di/Tereiiri's 


Ur.srhtn 


Tahh* I Kives dio total firnl mean iimnher of ivords leoalled, trials 
required tu relearn aiul the eaviut? HCore fm die dilTerent eonditions. 
If we mmlyw llu* data it n|i|H*arri llml llm results in terms of le.mll luo 
most clear cut, wliDe thoMo hi lernwof releariniiK and savinK/ although 



Thr Jf>ur7t'i1 »>/ hxih^ij 


aMi 

l!irn<*, ^2l)l n a 1 hr* »Shui ijr> nj trlcnJion 

fi's ijit ,4-Mrs li in iTi-4!, ni'-iJiun*?, iis'i s'rWjnu,, j« gn-aUnl lor 

no r44ni» no\ In «!»“ f( mi* .iii'i.''r*r<*, mnj in .otn uinr KwdK‘n«‘, 
Ou’ MuiiK’rJiMl -Ti n f»*r p t* nij>«J4 .ir» r4.i,pi»|rMl'Iv vtoolli r llum iho^* 
f<ir lio iimhnin% on <h«’ o?l.' r It isof Oj^y 'iNm! rijual for llip 
ll^♦^ kiinLn t»f fiinlii fifof tin- fiiulifiRnm 

r-lnmn in ilir* IhUt ili^H r» nl*iR il»row lipjii ujNiii n Ainila- 

iisi'n»j»l prinrijilf’ of 'lloj »nilica*^^ Oiri! «ny ^.tirnulufu 

Tabiw I Tun Fri-n jr'*» 4 op »•» ihv IIipj-j'Iis ht r'oMorinss 


f.oi'la '*«M 

lb n'S. 

*4 pat V® 

IV 

H*!« Ttj-jr'R, 

It lit?? U« 

1 , 

S'f C iTU 

1 H^sinR; 

! |«'OJ'nla(5P 

I'l IffirniOK 
linu' mvH 

Nn audif'urr 

Total 

AvPiftJtf 

'i 

) I r« 

1*^ 

'HI 

, l.Vti! 

?S O.'i 

1 

Auditiitr* 

Tolfll 

Avrtfltt** 

»»* 

11 

. 1 

1 0% 

1 1 l-Sf 

(,u 

AUf'iUivp flinlif-iii'f 

Total 

AVPOlRi' 

.Ml 

It VU 

11 

1 t.u 

m? 

70 


r(‘aj)oaw‘ HiluiUinii uiuiit. U* coiipiilon'il UM a funrlioiial vvlmlt' ('oinihliiii! 
of a conHlcilahon of nunirroim orf^'iiin'imr niml rnvironno'iidil fiictoni 
Any clmtiRC in lln* Hiluuln*!! will liffnri tin* o>ntlo ^i*' «'f iln* wlmli* If 
a Ix'liiivior piiUcni ih ortcn fnriiii'il il may Im' n mMoO li ht .hI in ii Miiiilur 
niliiation to (but lu w]ii(‘)i it v\iui oriKin'iHv M«’<|nir<'il lit our problt'in 
not only Ihf total organisation prt*M*iii at tla* lioa* of b arniii^;, but llu> 
conslollttlum of orgaiuhinio ami iMiviroiinmniut f.nUnr? ai lit'* ’mu' o( 
recall were etjMuUy important in (fieiUtutim? «ir iitlolaiiou r^poiiluelum 
T'able II hIiowh llu* iiieun uiuoIht of wuril^ rri’aHoil. <»f triab 
requirud lo relcurn, ami of tl|o hiviuk ja-r h?it ft*r < .o'li «.f tlo' iwo (’"ii- 
ilitionit, no mulii*n <‘0 aiu) aiulioiu'e: llio jirtibubli- onop' uf (to* tioi 
nictuiH from tlio llm*e eritoria ami tin* prnbabb* irrorH of tloir tliffer- 
encoa 'L'heni m a tW two ntiolMioo^ in all of lb* 

lliTcii criteria. 'I’lie one in toriiih of nrall is alnui^i fmn turns its 
piobiibU* error. Tbe tUffertuiwu m ilio in'*** t»f via* pdoarmnn uiul 



Tit tij ai, < }Ui>iU 


mi 

wiviiiE vft m»? KHf'»?, y< i <Jii v iiMlifa^' a cniiMnti'nt. tviulrncy. 
Tlii^t H rpfWTi/iJly it'fimrkftM** On m» • r*fr*-f*nrf )H*t jljr^rl 
of rrc.ill 

T 4 BIK IJ lhrr»i^ys«» N«* ,%’.n I'n.T7^sr»r 

F'JI U« J. 



iff. 
pAJ'sliSrr 
tf aP« 1 

StnU Oi 
u5' nro 

Mviok. 

^ til U'.trnni^ 

' lirni'isavtHi 

,\o AudifiKr' 
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Mr*n 

n \% 

iKI 

i 7h n.*! 

PK 

t'j'lo'nr'’ 


I-’ 

j 1 u 

) 

Mran 

n H-i 

1 

’ (iti nr, 

i‘i: 

.i( 

' Ul 

1 07 

]);/rpr(‘))rf’ \ riv*i')i t)K> Mn loa 

} M( 


! H 71) 

PK 

If 

'i\ 

, U ‘il 


In TnMo III wn lirni lln- im’MH inuiilffr <»f (ht* wor<l« r(‘cnll(‘<I, of 
triuln rtMjuirofl U) r^'kiirit, »«»! “f fin* h'^ving }mt IihI for ourli of Iho l^'lO 
condilionN, no 'onlnniro nin) nUvniivc ufuiuTtoo, llic proliuhic orrorH of 
tlu‘ Isvo iiioriio! fniiH ili>' ihn <* nrifnrin, tiinl tin* prolinblo error of tiunr 
rlifTcrr/in’-'* 

'CaiiMt fif '(ilk (nt'rntFHiK htr^HN No Aii>osi>< ami ATri^rivK 


( <ioa{0(iri 

1(1 lull, 
nj'IKMi’w 

III (till il 

){i Iriiroing; 
(nol/i lo 
roli'iiro 

pcrci iitiini' 
of li'itniiiiK 

UlllO BtlVI'd 

No HU<lo Ml <' 

i;j -ir, 1 





!M) 

7H 05 

\'K 

AUoilllM’ OlolO'lli > 

•JH ! 

12 

•1 11 

Ml 10 

)1 /U 1 

1 00 

70 nr) 

PK 

17 1 

' Iti 

'J 2,i 

Olffl'O'iu < (iih\i<ii tin Umi (iM (lit 

; 1 r'i j 

70 

' 7 20 

P1-: 

i i 

1 20 

1 0 01 


Ah lu'fore N\r lliul lloiL the MibjeclH with luuhenco give jkooror 
rcMiiIlh 'I'hi* (lifTi'ienee iHstwecii no autlicncc uikI uttenUvo niKhencn 



7 hr ij f j ,r aSi-r.i)^ 


(M 


j-t th^ti liTig^'r Uja»ii 5« *b«‘ frukUflu. 

Mve vW^>m ’tuf «*** ?"»t*7< s't ‘'Jr'.f'r*!^ If^r r^-i-aH with a 

«Jt«tf«nny J»^"’Mr-Tf'ii ^hr* >w/» f f 1 7’r in<j <1 ji7-.?'mjf f«f the 

diffor* rinf* S4f il»\ v« J'’"’' ‘‘l^’ii’'} ’••r* »>f 5!*‘' *»ir}l rlifTorr'ncC! 

Tht**r in^iifaUn n h»a^t •Ifr.f*'*' »'J ni»«’ 

'Du" i« ciintr* n r 4|tftj*l« r ih*' fliRnr* 

»n ivjvj**’ «ii i\,f’ s!» i1 f *« i« <»h. “!j *tn nVi^m^, 

Jo Jr f4?« iIh* a-/A-nnVi wJi'it# <tr> wfh* 7iiiffr||(/ifjn^an 

tU»n wJ.' w < '%j**‘r'‘>> ft i*» t *U I"* fojr i!}*’ n ;si«’rinit‘ntor 
\\V gt'm'mily Jiti4 Jitft* a 3ornif^’ i*<rj'*'l !« f4>llow/ i! liy iK-U-ot 
rrc^l^ **71^ rflti ffc^sriCwly ;* i-r* n^i’ln-ncd Ifarn* 

tnR ficnixt is tin 4^\t''ic^siM* I'f rxjv au ;i»i4lt< nw 'Htc* tils* 

rtiAfiinit of ihw howr-K^r, miJI It i\i' 1— h f? tinlj) Jatj r 


TAtitit !Y 


a>n*iT •a«wv<««i« r 


T»»* lIjrn^auHf'n hr^wi-iiH I'n.^7nn?<*u. AiMT'krit asj* 
\TtlJ|H7t»iC Ai SOlI'M M 




jr^‘ a''l 

V‘> 

U-At-'*! 




iviviiift; 
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ti{ I'^riJitiK 
liii!i'M\r«l 
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II ! 

1 

: m an 
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Table IV Rivejilbe nu‘nn m»i«l'»*r **f «>f iri'iU rvijnjrwl 

to relearn and of lliu wivmR |mt Iij*! fur imHi i»f tin* tint cimilitinim, 
titallenUvo and ivttentjvp mnlirnt^*, iln* pMlMblo frrnr» of tiu' uyd 
mcftua from the three criterhi and lie* itrolMbh^ <*rr*«r.-< ««f tlu ir diffiT- 
onccfl. There ih pmclicnlly ih» di^iinrify Iw'iwcen llte n’HnlH for the 
two kinds of attdloncea. 

It Bceins lliat lljo kind of mnlMiicf’ ik nul very Hii|H»rl!inL u« ri‘K!tr<lK 
ll« influence on recall. Hiwever, mir tvauUm iiiny Ih' u fuiu'luni t>f titc 
particular HiUmlUm, And it ([ml alioiild Ih» (ho cu^*, othorKriOip arrutiK^'- 
montfi might have diften'nt eonwtptonecs. TluTi-fon' no general 
conolufliona can be made From the vU‘wp<un( of (lie orgsimra(i<»u of 
tho audiences further ohsorvnlioiw and aiudifa nnuUl 1 h' (ieHira))lo. 



ihf ft'-i .(Wirs«'r m^»t/ /^I'Z/jfii' (y^9 

Tflblr V ron^aiirj^ Sfjf ■•JuM *.71 rlH- If asnuig nf 
la flit »»«}v »h<* r^iKtitiwnif^r prrwnJ 

TlicEol'' Hiffrr- T«<-i’ t n Ir.irujiip. vat^ 111 

tho fin*!, 'U4 !*•»♦ hu ur!\ whjl'* >n llii' oUior 

two, it^^v difl Xrffjrstiv «|,r< Imrnuip r'f(in(t‘noy to 

bcflUml rrpiHj >l»rniipli»oi» Oi/m ^|«iimi iH, urn’ ii -wt nnl to vary lo » 
jtrpfltor rn*i»!«5 U' f \jil-oii* <l n« 4|iM‘ U. clmnro. Yri wo fun) 

ihnt Nrntns w.-is f>u <h*‘ i-jjlily (•^ruorr wlion tlio mtU- 

;ecta fli<! not »njM rt an *l to* rUffi ronro in imnlH rrqum'tl lo 

Icam tlio fMTif'i of jMJirt li ^vtini f \fK'^rtjitK no niitllonec and 

when onlinfHttinp an nodn r«*'» o of tnaU nr « inenn of 1.40 


Tabi.w V 'rnr. Kj-rr-r r *«>» A< nii.’if i; mk lUfAi.t,, at tub 

ffMi f*r tiV 7Jlft HaTB f'f ?.»'AH'f|>tO 



ThUI 

' AvrTflRf* 


(•tri'ie.j'Ui 

!ri4U i(« 

Insls jH*r 1 

I'K 


J'-iin 

)i<^l 


No ovidwaff 


! 1 .Ml ' 

n 

InattfOUvn omiIo», r- 1 

i:i 

n I'tl ’ 

:i2 

AUi'nlhf' 

Piffewnr** In-'Ibpj'ii jjtt mt'h' . r* ui'j-l *. 

1 M 

a 1.' , 

1 

.11 

Uu tnnlwiii-f 


1 in 

1:1 


ini'0 0 ^ 


Iriab. ‘I’lio prolnM'^ t^ror of tho tliffonoiro of tin* two nnnnH iw .*15 
The notnni ilih|mn(y in u litdo uvnr (Imn* ttnina its prohaftlo error, 
mdicaiinit jopmtinnnN' Then* iin* no mBiiifionnt difTcroncofl for the* 
two djffcrenl kiinls <if ijuihonri'-t 

The, fuel that iln' iH*4jji-lo nonifi'd iiiom trifiifl (0 learn (he inutcrial 
when tliey wen* exju-i'tinp; «» mnlinn'e inaj’ In* esplaincd aa being due, 
to difference in anin't|tnh(iii, uml iniegmlion willi reference to the 
IcamiiiK Rituaimn AiUiei|m(inK an imdieiiee Keeincd (0 hivvo been 
inbilniivi* lo lln* Ic.-irnniK The nubjerla’ reporla dearly indU 

o-ftU* that Iheir kimwledpt* of tiuviag in recall liefore apedatora ciuiacd 
Konie nnefUfincHa. 'Piicy nppeari'tl In learn will) (In* iiitenUon of know¬ 
ing tlm vvordrt well, ami of la'iiig aide in iell iheiii lo fionielKnly >SiJoh 
«u attiunle waa inU reenginraljle with the HiilijcdH wlio did not look 
forward In an nndieiice; ilieiM* huhjep.ia appeared to learn without any 
definite end in vkmc. 'J'hew* arc* the faots a« llioy aro Ijoforo us. Wo 



(ymrUi*!*’ (r'fisn ^Ik-ju shn? »ii rR{<'fi<4 mruhiujUF nf hjcjH 

nift> r5k\iw' fAin< tUJff It iu I ‘M' »'f l< ;4n»M»s5, 

It hi'i'if* 

lU^laeiriR iIk^ fat'i »r« !]ii'V ir {ft*ui i.ijr wefiad 

Umt‘ 

I II iunirjfc* i3\r<' pUtif* |»r>tnVly, il» |iirnfv mI ;i ftmiip at the 
liiiif hf ri'r.ill iB ♦IrinriKi»t«l ?■*♦ »k> i-I re j^riKliirlion 

Tin* kiu'l ift i»«'t M/y Jti4|t“'rinnt rt-|£,»trdH 

inftiU'nrt* rm irniU i". ui lUm nMUUfxlum Ihr 

sirr* PL liinrliiiij i.f fnUi'4?iAii, ajaI ihfkl iillifTRnjup 

flmiflXPlIH'Ht'f* IID^hi )(l\r illfTi'Ii Ml 

3. TIir HniinpAiirAJ mI nn mi'h^nr^ r»”r ill, xl fin* iimf* nf Itam* 

Injt, iurrt'iw'e-H tl|p }<»niii»K uun% m\\\, vi 9i\>\u> ihm, ihn «inmini 
n*IT>nihl^rf’d If w* «)imi nriU Arnir'k n* oj'li* un^ 

M’hrw* n-Fulld* kuk,r<'’i( Uj:>» f|n’ liMpit «l.t» j‘• fij|t).'«iiw uf not Widk 
rtbic Ki /i'iiu‘iMlH*r virll wUin r****!!* rU «! Im it''' IhYmm* h nuiy not 

be IryjiiR lo n Fi«tUMbili?v Uiw lOAl iliiy 5«» n roll n'svala r 

fundHiDcntnl frirtor of ritr'iMory, niol rbonw Uen! )br Hiinoiion liunnK 

ihc lirrir of IrnrniriR nn*UlMrir(K iji«* hio* »r» rqHoUv jin|)i>r(anl 

in facilitnliiiKor iuInlntiMR iltn r« '•iHiMii* 



TIIK lUCl.A'riVK IN*l'r,T'KX(‘K OF VIS^^VT, AXl) 
AtU)r[Or{V FAfTOHS IS SPHf.LfXc; 

AHUA'I'Y 

W' IIAinSUNK 

IJrJvTjtrpirn* mi IVn(’J ir.Jp jj,, !'♦ Sjua HSjit/* < 

A IUrK<,J50iM> f»r nn. Fihwu.kw 

Thf* f-|wllitijt hf ii1m‘ ftvi'r.jsji' nn«l‘-rKn»tlimU‘ i« nolorioim. One* 
auppret** tliuf tli<' yr'’!*! \ rpp^iu' i.f oliji rlivi* rxiimuiriiiuim \my Ik* j)artly 
pxplnnu tl Py Jln-ir |k*wi r dtic lu illr*Kii>k* p!iiK*ra, 

dwtgUHi riuiH'tl l»y atid jruHjjlinn ln)rn uf rrportlml 

nni^p<‘)linK‘^ Th> m' »•unuton un* puiMiinont in 

HCiPiin* nnirH tlidi* nifn ff a ((‘rliiiiciil v(!(’iilHihiry 

appa)! Ilf iiijjjiy in«lru<'lnr/« an* Ihi'rr 

uh(» nfiiT «A|H*vn4» 111'ir I'huu'i ^ (n u vi'nr of im imiiiIi'dI iiiul tlfin 
pfpyrli'do^V moti' Jik'* philt»>.(>p)n‘, pliynolti^y, anrl philology 
lliun liko iin own tnn* ^^•If 7 

Thf vnrioiiH f\|i)'ijmliiiins wlnrli liiivf l»{‘fn mlvuncfi for Hpocml 
ciliili(if« nini (lifulnlidrH mm liny nouiifi'^i iliciiisflvoa in nradpinio or 
Vdt'iilnilinl lifhlfi nro hpl linnllv fonvinring In iho cuho 

of Hiirh u n-f^lrifU'il fniiflnm oh npflliiig, r 7 , it ih fiiny to (IpimniHlrnU* 
liml ii Ik not nn oM’luMVf iiropt riy of ingli or low iiilflligciicc, iillhouKh 
It IK rquiilly ffrliiin ilmt it ik not iik iinlfpi'inh'iil of gcin'ral niilivo 
aiiilily HH Hiiiiif f\(rfniiHlfi wonlrl Imvi- ih Ixdn'vo An nnulyHiH of Iho 
conituonful lypi'N of frror.'i Ifuih (o I he* KiHincmn tlml viiriouH sriiHory 
and motor ithoh> orrn'-ifH ao- tlio mopir dflormirn'r^i of performnneo, 
hill n7^t<'^ im(‘4 urr I'nirml h jh yl nnkiniwn. 'J'lu* curronl viow neoinH 
lo he tlinl f\fry )Mior hpclli'r iimhI l>i* IndivKliiully (haginmi and 
fipanlic ifini'ilifH prf«i‘riin‘[l an ohvioiH ctiiHHjiK'iKM' of an implicit 
hi>]iff in plural ciUHnlion 

llowfvfr, tin* Ki’ii'hliln* M‘aifh foi u<l(>([ual(‘ Konciidi/.ulionH ih 
not l(i ha (liHinn-MMl mi liuldl.v. -IuhI an il m proliluhlo lo know Ilmt 
HUjHTior intfllfflH Ifm) lo liavo i’Ojn‘n|ioiH)ingly bcllfi' jiliyrntjUfH, 
fiiiolional ronlrol, clc , ao wf ou^hl lo know wlm( the Hignificant 
cliaiactfriHlicM of a good upfllrr arc na dHtmol from a Inul oni*. 

Among (In* uiimy f\plnniitionH ii<lv»not‘d for poor npclling, perhapH 
tilt' inoHt rtiourrfiit ono ih llml which ntlnlmtCH it to Llie non-phonoUc 
nnturo of the iCngliKh Inngimgc Worn ccriitin ftomuls uniformly 

otii 



7‘Ar o/ f j ^ *5< 


M firf'iwm^li Vi>’ 4rftn>!** fi'ifloij)*! in»’t)t*nlio rorrecl, 
wjx’lhnR. 'Hk' firKwa!*'^ ••? r«'fw»!i.«’‘3 .ij'j'.jrr'n?)y hikr* this 

M'n«»np|y, rlr-hpii/* (•«<■! "Fn* .-r^ur p!idi\i-)y rqual 

frTijurrtry »n luRlily ''«o.j?iK'»i p’ir'h ''ft C•< roroi r>r HfmtiiflU. ^ 

pHlihUy in^rr pUiviPslk i3*.w \» uln’ »f u ix^tKin 

txHiUl pronriunw’ ),n\(‘ n«i liilUruity wnh 

Ihc'ir firthfjgmphy, 1 iJjp f/ulf* «« fw-rniup for llin fad 

(1ml many Amr/ir^rj** r.nf* ffiJI Kjriirlj uiU‘i» prop'rlv Ihii (trnnojuicc 
thtm in a very nnfirih»rt3‘«\ ruml-irSy f'ir (lif rnnclimaQ 

UKtiR KnRlii^H. M»ir»nvr, n}«»*i m5>i'jv< JIwjK-* m** j'UlyMituli^nft or 
dln*pl.ft4;«iOf'n(ft 14 U tuj-» ijm «!»T'‘>rb »sf iitriRnmlnm enn be 

ftllnbiilcd loffiuliy T3<r'»b5iMr>\»M4MiiinjilMuioflhe 

promifi<sift(H4n ?«« U‘ jm ronH*'<|HPjiri* of ihc 

finding (bui d«’7«f-iinir<« un* H.h(inHv ii^u^ r >n pjH-lIjrjK (Irni in other 
school HiUjrr(#i, 

Olhr'r Y)»*w-)Kiin(^ Jcao »1»'‘ tM‘‘ "f 

Hw i)h^ coitiiooiM'M 0(0115011 5« Ib'i* |M««r nj-oU'-Tf* riro il( liMHil in 
vlifiml iriif4t<*r>% liui (In' trtrln"i**Moj*ir miojii nf r4|ipp'’)i*’n«iiin liiw nlw) 
l>«*n C'oiiMcIrjr*! jw nfio fm *or 

WIktt Kuch tUvorp“ imd rot(»tH4ir(’'ry »ij>mi'm>? oxip', a nwiri Lo 
oxfirrinipnlftl mtnek in mdtrntH T»t (In- Vi/piT. (ht* prulth in pimwd 
Uw.’lf a^» follows: 

l)cK*a (•xHh‘nrf <4 »u»lnor.y or viaiioI |n ni-pfno roiMriiy piny (lie 
doiniiiiiMt rAlc in h(M<iliiiK )H‘rrorni/i.n(o7 Jm ^(>t ||iny; nlnlKy more 
cbncly ttWHicmlod vviih (lioso* oou'dMriH noMfirdtil l»v rlio onr or willi 
Ihow involving: (lio oyo? Tin* viordiMR of iIm m* ipiv-iinnn l»y iinpUca- 
lioii minliniw'H ihr* ijjfluoiin* of molor Iih|ih1him)j« jik it i*' osMinuni ihnt 
chnncefllips of (Ik* ikoi nlMiubi ornir I'lpiuUy oft* n sviili Imih Rroupi, 
and il also win m ilio liat'kgronnd iho miliioMoo of pin li c’liinil fnolora 
ftfl intelliRcncc, lypo of irimRory, ftsMirmfioii^ i*(i> 

H. 'riiK Tiktiso rifoi} 111 iiK 

This mvcfttiKalioii iM-Ran by udinjiiinlornin in lurRi' o implon of onrh 
collogft cltiHs from Frrnlifiian lo .‘vMiior fi»i\ liundrt'tl (liirly-nix cuh'h 
in fill) u lent cniiNwliijK of fifty m‘l<*c(t‘d wordw aiiponruiR m biilli 
tlio Tlioriidikc and Horn Word IbHiks. Cjnm a inrcjcin'd t*lici'(, (ho 
HalljoctRprintedinicb wool nail wnaH|H»k<'i} nod iin minviooR dluKUuP'd 
by a &nm])lc BcnU'imp. Tlint Ihf' IrPt wtw a n'{i‘>omdilo nirnnno' of 
BpcllinR ability is indicated by lh« r<*Hwl>l)i!y etHdlirnml tif HI i- l>07| 
obtained by tlin apUl-lialf tecliiiique For the purpoM^s of iIuh exprn- 
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incnt, rcprcwiUivUvo cuiicfl chosen from the tniddio and both Inila of 
the (liHtnlnitKMi wcro Boleelcd for iiUftiiHivtj Hludy. SixLy-thrce 
individualH were lima obUiinod twenty-four of the best Hpcllorfl, 
eighteen of tin* ii(K>reBt, nnd twenty-one average ouea centering 
aruund the ini’diiin HCore. 

The following lest aeries wiw ndniiniHlered individually lo eiicli of 
the Hubjeel*^ 

TiU 1. I'trccplml .Span for McmwmJul Mntanul {Helialnlity 
.7>1) IVun the middle of twenty wnnU white ciirdH weio printed the 
following unujuml wor<lH, denveil Inrgoly from Whipple's well-known 
iiifonniidon teal: 


ageratum 

simony 

("aedmon 

synecdoche 

cleiHlogannms 

trephine 

gneiaH 

tnlolute 

guimim 

WeiainanniHin 

lieniiiilera 

ononiaLopoom 

impetigo 

sphygmomanometer 

iidiigtio 

exoplithalmic 

metacarpal 

Ahderlmldeii 

IK'iieplriiii 

La Rouohefoucaiikl 


OneHiccond expimnn'K of tlie oiirdH \mm(* miuUj tiichiBtoacopicnlly; 
during the mK'rvals (which viuied willi tlio wiiting lime) the subject 
recorded the won! lie luul seen The total number of ropioduclioiiH 
corn’d in (‘very deliul eoiiHliluted Iho neoie 

TcH 2. 1 liiaujmtum {ItcluibiiUy ,01).--Twenty common 
words printed on euida were evpo^cd to the subject at tlin rate of about 
one per socond \Mlh instrudionH lo fixate eacli item Immediately 
after (he cjnginal heru'H had been seen, the cuids wcic aliufllcd with 
twenty oilier ennfu^ion slimuli. The mixed set was then arranged 
by tlie Mihjeel into two [ules one coidmning llio caids the subject 
had H'eii 1111(1 (h(‘ oilier eontainmg tiiose he had not seen iScore = 
2 X iniinbei of ('ri<jra in both piles Kubtracled fiom 10 (Vor the 
exact ileiHH HM* lln‘ lisi in (lie wriler’a appendix lo Archmii of Psy- 
rJidloiiy, No 1011-) 

TiM :{. StInU Whipple's Uigli Hcliool and College Form 

H \\a^ adiiiiniHli’n'd in uee.ordanee witli llie lime limitH and obhoi 
condiliouH Hpenilied in Ins diiections sheet. Score eijuals the number 
of coiieel aiiHW(‘is. 





mi 

1V"J -I iiiiUti jfr-i Kh) XhTfl 

« jiifnTjjrvftjJ f j}r 3'"1» wnf/l m ri nf 
rimS^-'nfiil, mjjJ^44^-1 ih a nnh?<f'»w‘-r‘ mDrc* 

Sii'Sj A swiMiiUtu*' Jim*' whr i-fpinU ihe 

iuiimIkt‘ 4 |<JMj«<rl^'‘ijj'i'i3fi«‘ I 

7Vnf .'i I tiU . hi'i ’111 j?/' < '«?<■ i/.VJn.jf’‘.li, pjjilplp 

"IjMiur' ’Ji* *<»} •* «'I*'t}i \ 'i'micof 

ir»H''<'ri|<?»'n «.««- J'>* •) m ■'■*• ■ 

I'fif (i l/f**) iy>i-rj/'" Ih s' ^74) Tllp 

rjtnnVixf *J4»' •'«»»ji‘H pi| Wliipplc’ij 

rUliUVtllS Wrft' h "S^ Oj*’ »’! 3»J Wjlli ,» Jih “• ftttil 

rr'ffordcMl l«y Imu ».« 3{« u-i »34»' rorrrcL 

roproflur^mn )?» « H Ki4\»‘ M>» 4» »')»>■ 4 mi* i*"ir*‘ >*f'p ist 

Tf‘i 7. /Vor<w,« r«3fv-^ ifirU-i*•I’-f i 7‘»' "n{«* fhjrJ> iu»« Hdrtk 

fiiriMiDj^ ill'* pr''inMJ< t'rM^'M «4 * T/-'(• ] Mvjli'li ’ri Mr-rcuN'd 

*l li<* |»ru<u*l {if* Vv,' ^ ?h«' "Mkj* -1 vkt*!i ij, <»♦ urtMimnirf* 

rarli ^^^.r^l a** i<«* n.r< kpiMj; i4« •! ft-r pMrj'v »>f liv a 

iMHUungt' t« jii'luT ri»*' ‘‘\j«'X»M.* M** f «i;«‘-V.* 4 *!:*' lU'ins l)y 

Jifl^'iuriR r.in fuHy nn iln' Mikp-r* |j;<.r* < 4* <} 

Tri-i s. j’l»i4}f‘*Ty /^fd..(;!,>}»..?i A h«t i)f ton 

(mluiwry \\tir<l« WHh n wl «* :m I\( II f'i*< r<. tj,* eiiliji ri vMilnnHlrur- 
IMIIIM Iti rix«!i* Oh’iii iifMr »!im Ij-*’ In 4 Jk'-ii r«‘n 4 , » 

UiURtT liKl U^i’Uiy uortk th* imi I'npiMMU pluH icu 

ronfu^»iii» Htnuu)^ wof nffi'n'il At* ' m)! m«*/ 4 m iIh* l*td h'^l wan 
uIIvkmI, vlii* hul>p‘cl Htitl "ji'k" i( Ilf Inil U< ii4 »r Iri'forf iunl "im” 
if ho liiul niU. 

The relmhilUy wn'OinrniH fidr i nh of ih** 

mc'fisuro^i won* hy ciuplical^* iti iIm* ofli, 1, -'Pi.S 

unil by innlchmg nllormUi* iifiiii in ^4^N 1. 0, 7; f»»r Tr*-! 4 ihIimhuiIo 
rohftlnlUy ulumhuiU wore tuMiumcU in Unw Ucji nu'i l»y ilu* on^^iuutor. 

UVM'MW 

The ini'iin {lorfornmnco <>» <*»rU ui Un* |>r«M'i‘il)MK n^lii wuh 
ftopnriilely eonipuled for onrh k*'‘“U» <4 niwIl'Tft (Ih- MiiiH'rioi, (lie 
iwerttRo, ftud Iho mft^rior. Tuhle I Ih*Iu% 3*nH0imnRi“rt ihf oH^i'nliul 
ilfttft for iih oltiwii'H. 

Before proceodinR to n» inlerpreiuiinn of Uio luMi-, lot Jl In* nnUn} 
tliHt if fipollinK iitjihty Iw cimdiiKnioil hy oxcolh'iu’o m viMuil jiorcoiiliou 
ilien Uio "good" group Hhould revonl m delinilo KUfKTiorUy ii» IV^lw 
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^ The D 'SDdi'f comparison is of course unnccesarj' with the third group. 



\ .S „ i •4'i ?! f 1.14 ..‘.'tlV 7> f* -If *i<--lv«, }»^ 

(arSfl^r''lie'll O.* f ' i »},. 'at-H" ^ r 3fJ SlOrily^vt 

Thf" riij’«‘’''t| j.iri*.v'TT "f 3">*14 ’K' yj-J’- ^5 ;iTj’ 3 jxbof uodei 

"lh<’i ^^« <•'» '•( r-aU^ J ■*'• 1“' *'?.-<»«i f* *<’'. »}-'tS Ut»' 

of fii.ats'Jwffi ffJirthhiv tfJ *?'• ’«T/ f^i^Urrutt’S l*c‘Uc«a 

ftmilpf' ?< yj shyr* 'f ii1'J?45v li Wjll 8f>tn 

ill unti' llu* ii«jv f‘» *3'» I?) 6^»' *1 wiji'P', T’-^l \ Jilttin- dif. 

rriUHti'iV!*; sUi ;i'“7 "I» iVifi'j,;* ‘i "i’ll in Uirn (toiti 
thi' ififrrj'^r r»'* 1 ^ «, .-in'S \ .V4 f3i« j* »>f i)tt' coiivrnlioQal 

T* rj.< 3#J?4 < ** Sh''* p««k 1 ffulii iht' 

niriJntf’J'’ Inji f j^Zts *>n mu**' lUr l-ilUr nfitl iV 

iitforn^r “ 

In lUi' wutN'i'O' J*‘» f'P* f•> fv»4r.N.T <$].flrniiiim.tUir)' fwwer 

wiib lb«' r'xr4j3io‘y4 4*1 I'i ■»! 7 -wJ.v^i f?-'** rij'R' y n‘^5 45^‘ tin* u’lcrflKi* 

from lhi‘ sj^fUf-r^. 

Apimmilly Trrl I •'! M'UmI |{f*oiv v ilo mjo* wlnrli riiu Iw 
UM'tl l« fKT'p.frgni*4* j1»< ^ irO'ijw rKii»<n *•! I'jjMif Tlu'i Iwl 

columnii a ftMoji r-f wiMrl* * \« "pi* p from mmuslmli 

mommy wmoi .»« U»'y !iav*‘ \** n »•! A'*' "r‘Iknv; l*» ilio I'Vi* 

ilcnir»‘ wlucli iln*» nffimlw. p|*<-'‘"l ajvl 'o<urt*-y i-f iin»i.«'<)iiiio ywiinl 
(K'rx'ojilif^ij I'XtH fhr (imivMi in'* iti|tn<* > u* i|« jJu ,i ('r»>5tr[i nr) 

All nU«'iii|>V »*n« Tf<\^ mi'l*’ i4» ►'« » n* ili** )o ar’’ >'1 ilo' }»rul>!> >n Ity 
ccMn^mring loiwl fr’Mt4wr*i »* i•■.''h il.* mu‘! funliiory 

Uatlorft'i* fur K'JicU uf iho ilm'*' ol«i5<‘y i tiiji|‘;jnMiii iwi^ 

inndo npfMlKniTpifnio n/r/)rninn<i p/po- j** 4*f '41 phI’;* ■'”' in « n li 
dcionnhiMl, nml ihi* mr-an i>ii;nm i.f »-!i»)i ulonts nioiip 

wpiiruK'ly ccimnuiH fur tin* mnl «u«Iiti.ry mto '* Tliii i' 

ii iiiofit lulNiriimn n[K’mii»n. Imt il-'* f»'n«oMM^ riMr kivjs t)ii' 
comloimliiiii: 

Taiii,r II, '•Mbas HIl ‘| mm'p }<rM i \vi’. ji i l »‘\‘«’ i • iv \ i"! o 

AM* Ai ojinar 'I ji-f-i 

VvBMRlUftUi'TV tTiTnA 1 ii»ifS3j*nf) \t, liV JO 1 t»vj, ^U''*'*' n ''nn 
tHijwfrmr [ Avpmsw |hf«if<ir \‘.rr,'ip‘’ Itifijinj 

■ j m ! - r.i i\ III IVI 

‘ SincQ Uio »eoTwi in Tm !» ii>|)rr«wrnl l^iu^ * »Vr{j, \W I.«w« -i «li 

UiP bpBl |>erforji)Miir«< 



FiU'hrH in G97 

Tho reu^^nning w’lndi w mUwIpd to apply ih: If the Huporlor (or 
infcnor) RpcIIorn rirr i<uc'Ii pninunly liocaiifff' of high (or low) viaunl 
I>ercopl^J»* rrqmnly, iln’ii iln*ir rolutivc |M*rforinarico slioutd l)o most 
nmrkrd in Iho visual HTir‘« Ah n tnuMor of fact, ihr order of oxcel- 
Icncfi iH abool the I'aiiu* in iMifli ImlfoncH (Jood Hpcllors, uppnronLly, 
can OHO llo'ir i-am i)r<iporrmimldy hh offcolivdy uh (hoir p.ycs, wliich 
leaves us iinrerliiin ns lo winch of these mmses (heir prowess should bo 
altribuled. 

As llu' method of relmlde ilifTen'iires yichk'd mich ambiRUoufl 
evidence, it \mik nei'essury to up)H'id to further nnalysia in the hope 
llmL this ssould re^eld die (me relntumH ishieh conceivably had been 
obscured liy stmie kind of roiniH-nHiilory masking, llaw correlations 
IxiLween the spelling nrores iiiul tin* eight tests were Ihereforo com¬ 
puted, and (lie foiloiviiig coedicieiits obtained; 


Ta«i. 15 III ItAW (’(man miosh ScBW.isa Hcoiu.s amo I’BucarTDAi. 

T|•^Trt 


Teat No. j 

1 

1 

r 

l‘E 

1 j 

; .Mt'niiiiigtal jM-rffpInul ^•|mn 

78 

.03 

■J 1 

Viniinl oregoiladi 

.no 

07 

a \ 

Hilfiil O'fuhnK 

.47 

07 


Ibililea worda 

27 ' 

08 

‘i 

Hab>tOliiliMn 

41 

07 

0 

Auihlory um iimiiv h|niH 

ir> 

OH 

7 

Priiiimif'inlioii 

fl8 

Otl 

H 

1 Andiiorv D'^^tKnitiwii 

4:t 

1 

07 


'I'iuh iiielhod M'eins to rluTk (he resultH iireKCiiled m Tabic I for 
ngnin Iho test of iM-reejiluid span is predomiimnt »^mco llio ? between 
spelling and the (lain of Test 1 is alleiumU'd by the impoifcob lehabih- 
liCH of llie lejipeelive srorea, •SpLMiiiiiau'b coireclion formula was 
applied, resulting in an / of ulmosl U9l It appeal's lliat the two tests 
measure niueh the muiio function. 

A hnal utleinpl was mude to budd up a legiession eiiuulvon from 
the three most HiiliHfaetory visual lesls, vts, Tests 1 8, molusivi*. 
Till! iiusdii d'Otie of tins was thiil if it emiUl be shown that luiinittedly 
visual faeloih p{isr.i adi'(|iiaU‘ predictive power for degieea of spoiling 
talent, tlien they must be viewed aa cuusativo influoncos thereof (m 
Hume’s .‘ionse) 'I’lie following culculntiuiiH uie accordingly picscntocl: 



fhi' *■/ .'J'.w .it? 




5'5 — " «*.'"?> * HVi. >*f<'^d'i''<.H r<>j}nl 

A’s ~ l^^n\ *\' '\ ■• U>\\ ^ fnrrn) 

ll wiU !<<* fiM'iin’ 't 0, V *.).«" jnn5‘!i|-!' ‘■■'rr> t"J i i* Hi U'» ^{iy Rn^Alr^f 
(hail ihr r/*( i-f p-'I** *u4‘ j !- f i* 0.‘ Ih t’ i* i’ r.f nvir 

snil thf* A|wllinR fiMr*® ilv* f.1i.,M-i* (jui'J?** jr- f)nf ilim 

r-arr!r*:ft filn?ie»' 1% ■!,»• /'wl ?■ ifJ* w *if j.j? -iK'ts'iji 

I 1 f 'iMH# 9 >' •‘J*’’*' 

Tlir linrimp** iiri'Mir'* -J j» "i.* i’j» v.«-n»* »-f .’'p.n ‘h* jt*'S ri'a<lily Ipiui 
lliftn»A]Yd’ft Ui Hny rlfirc.ii u*?* T|»n I'li* rMil'nh pni^fiMinnsl 

"lal'f'iiif'nJ-f* n|'j»*'ir l-x K')»>•»*.)!."! In I)* l.fi" "jH-lliriK nJulily 

Iff iin rnnrt* « iJ v *’-) i) jr* j- ‘ »}, >* ih of Krnt'nil 

audiUTj' jK*rfr*|iU«’fi N >.* jr il -1, vx, iij U iji^wly h'lulrd 

k» IIm* Ap4<*jl f’,t*'''t'*}i in s« i{>’ *’>'ippirfiHy. 

rSijfffpW AliriHi]! f>l n I’lDjiunUf of 

rihmI »< *’f 'f»‘‘ v«‘rM 

Wfl with Rranr ►itlii)*! h-'*. hjnUinR .tl'liiiy in 

n (nn<*T'»i». will* u^tiu *1 jm faPlt)r< 

<if «n nr fUiieil uvntn ,ii<’ »s •--n >|u* i/i J lliir'lly, wlul- 

ihe Way iM *l'’!*'nuiiu‘ "(MUjutt *1* n" ti' nisSI Rjii' Mriipli' nr w:ib' 
niellunl, it wnnM n* ur^ "Si»' n.* iroi.p-'fnl riv|ii»tfil Hpin 

l<!chiiit|iip Rff hii siU<'rn?*!>\i* »Kj. I, it j|,,' ii*|vfinliiR‘'of 

brt'vity. lAiurifily, all Rhn pm-* iJnv a’ ph-oiM )-« mn-riirdoil 

in llir* lifthl u{ llh* J}r»i -»ll »ln' «!4»i, l•‘|•.u^lK Mi'- I'urn l iiion«, 
fKTtain (0 indivitltinlff rlii»^'ii Inmn « nf Mp- m> ip-r i^iiii iKh of ii 
larf^nr curv<* 

i; .^1 MMAUt 

Tl\ia Btufly concit'n'P'il v»»Ui Un* iin* ^'Uwu I« Mutv 

my form of wriwry v*UnU ih Mp* m ^p'r tl'-’ornmu-: o( 

apcHinK ptofjcipnc'y? Hixly-iUnvrnUt'K’M »««(• nin, r« pr«niiuKrr-tiH'C' 
lively tho U'al, IIig wonti, aint tiu* rnoMb' b'Vi-b. nf jH’rftiriiiuiM'o, wm' 
Kivon ciRfil liilKirttlory ti**u unofu Tlu p-’ u usa f« )1 inn» ivni gnmiis 
one requiring tho use of ilu* vimial pnilni.iyrt ou>l ihr oiln-r 
on tlio rccpplora for iwund. 

StfttiBlioftl trentmcnl of lh«* rt'aull^i fflimvi-d tluif ilu- vi‘*iiiil battory 
fl* a whole did not dimmiiimolo niiumg Ihn Rmups imy f« iter tlmii lli'' 




icifral miiliii'ry iiinl iw kw: mu' wml hi, \mm 
|ht (if iiiiiiii'iliiilc iiinitmy apitii fur iiifaiiiiijffiil yipual ^iiiiinln 
(orHnlfil W' 

lOfdir'KiilHlK'lb'' riiMiiifaliilily 
Ilic iiiiijiif iiiiii’miif Ilf iIp ih iIkiI [ilnliy 
IB kfKfly ili'hiilmi! iiimii wi/ of ^hioI n'nriinti iiml imi 




FUimiKU DATA 
\vi-:T{;n'nN(i 


( (iNClvUNINt; 'niK KFFKCT 
KXKHCl^^KS IN NKW.’l'YPK 
i:XAMlNATrf)NS 


OF 


r s\ miiKM, 


T r f I.I.r >• » 


Thv siwilujTft <'»tI> i** ilfvoVcd 

WMWtlcralil*^ and < rirt’ f*i iIm- of ^u^l}Kl■i*^‘llly hcou* 

raU‘ iJMiiilly Mfi 0 m‘ l-aMK of ^i^iWnhy, W tlj<* (‘If'iiiHiU 

cojiiIKiKin^ llu'lr W lUnn h U w y jitk Jh4k< m r, a N'lidmcy 

lo diwonliniK* t^r* uw^ nf «|»jh .m'd liy ])(»iik1{iwi 

nml Spc'tvi^r’ nu\\ \\ vwi h J.iuh tiirU nin nwdnlvott 

IxitXKCPii ecnrcK luwd mwin fiirli ainl no-piillf d "iiinvfiglilcd" 

or raw BCOrfH. llial \h, lhi»K* ui«'n vi.>' /Honf fiT r arii rlarm-iU, 
lliftt Uioy 1 p(I Ui Uir C(mclu»n»n flnii Oa* roUMiN ainrainl of oxlru 
work luvnlvrcl in clfTiviitg rtinl iiMUg wn^^ia wth uiirif' 0 Of-.f!iry. In a 
rcoftnl nrtlclo (‘orry^ Ima pn-K'nU'd hMjjM* d ^nitiNdy aiiiJjWTl 

lUiB cunclupum llo \m\ iU‘m <»( « m m oilurulumal 

iwycliolnjty ttoijthird by nx iiiwInirUir*" in ilmt hiibp rf From ilu* 
rwuliB li(» (lf‘(<’riiiiniHl Uir Mirn'InUrtro Imihi-oh raw ntol tIi(«K‘ 
COiiipiUrrl afrordini; Ito m\ N‘ri<N id wriyjitfs aiol ulmt (lio rffcci'* 
o! Ihe (lifTcrciil wpighUiiK'* Ioiut iMarkn uiin wlnoh iho Irai 
HCOrpH wpK liunBuniUMi, F%vo »»( lUo hlv wiiU llu* raw 

flcorrw ranged from .H‘J lo .Ks, ilit- ntlii'r Nang Idl ApiiroMinuU-ly 
oiio-fuurlli of llu* pa|KT« won* gi\<-n ilo' ‘•inif li'tu-r mark arrnrdmg 
to nil HCvcn HCorcH, and nnoflnr rourili oaoli ucrording to h)\, hvo, luui 
lour ot llio «»vpn. Tlio markn Horordiiii? fo tin- in'^tniolnrrt varioil 
from ihowj Iwwd on raw arim-H in (nno twonly-lvso to forly-iuno 
[)cr cent of the piiwh. 

IIccftUBO of llic uonHutPriildn dih'ign'i lniv\c<'n 
and othcTH previously nhlHlncd, f)ii< jnrHoit wriior wo* h-d to nmk(‘ 
two Hludics along Ou* aann* line. Ili-fore |mM'«i’<Iinu U» pri'M'ut liis 
own data, however, he wmhrH In offer one un t 'or('> V ium'Mi- 

* Ilnrl It arnl IVirr I» SjH'ijrc'r In li Nr- fwir'ii' in W' infu I-'ctii''* i 

ihBtanikrtlTijaU? Journal of KitMntuimil Vnl XIV, I'.l.nitirv, lll2:i, 

Pl>. 100-1 Vi. 

* Coroy, Stoplipu Maxwi'll' The FArri iif WmrIiIihr IAiti i«''h ui n Xcv. 'I’yjii' 
of l?xnmlimlion Jounml of Kl^u<oi^oru\^^*^^}^fhl^t•lpUi Vnl X\I, Mhv, HMD, |>p 
083-086 
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gfltinn n nii» '4j»f« -jr lu anKlp, lull flu* w rilor Impiwnj* U» 
know llint ri\<' I'f ih" «j\ iif-iniHMrrf nHBij«nril of lo wiinn 

of llin rlf'niiTOf', nu«l llui*? Mjf of ihr> px|>f'rinion(. 

A Ifnt which cuU'^uiirt f<'iiu.' »|in» iIm imt ommi in (IcfcnnnijiiK 

Ihc Kcon* iK for iOl pr,iclu''-»l iuir|M»ftiR no lr.iiK«T lhf» ffunc Ii^rI i\h if 
all llic rloiiii'iilH fwi ih'if Ihc r«"U‘T!iI cfTccl of tlH« fnrlor 

woR lowj r iIm' oli’Mru «l r^irr<'hi*n«nif 

Part of the «luhi vihirli the wriicr wirIur Ih pn wnl ore linml upon 
a fifty chuiieni loulUph' uiihwit !*»! with four Miptsoaictl aniwow to 
each ch'nu'iil Moit wo*- ukHi hy hjxIj-I^ko MiuIcuIb in crliicalioiml 
niPHauoMnenl** ‘J hi* ^h'lio'iJlh in ili** werr* sscii'lucd ujmn five 
different hiin«-*fs iii n*l«li*o*n •<» tlio mw aeon* 'Him* baara will bo 
referred to by rit folhina. 

] r/vw fii c«3f* jt-xoU fKi »* P't-uj»at 

'2 '> j«f flOj.Piii!- ffl’ liiif noa rufo^'ilv 

r) ilifie ulu an (l(rtti)ali ajinlii ulinn o( onrnini curve (o 2 

t e- rnuil'im u r.f "i.** Ot live 

.*) fAlcl'-UI «l*'5U.loUi<»i4 *.f «<»•• lij l*'II 

fi - ru 'S'liu i»f ixriithtiit oni’ 0» li^e 

It. s\ill rf"ultly 1 r‘ Ilia! IIm* baw-n of NseiuhtinK (‘iiipluyoil in tliiH 
ex(K*nMu‘ni were micIi at lo ki\i‘ no lirontiM* of agrecincnl, bouveen 
the weighty, iIiuk inuhitut tin* roiiiiilioiiH of (lu* exiicriinont inuch 
more unfavorulih* to ^^‘nlr^^K ImkIi corrclalioiiH between law and 
wciKhteil Rcor< H fliun if wei^litK Innl lH*en iu<'*ittniMl nccordiiift t<> the 
opininiiK of in^lnirOir'^ who nn^lil Im* i*\|H‘eted to iigree to Konio extent 
at h'iiRt. Not only due, but in the eani* of baH'R two and (Itiee. a liigli 
npRUtive enrniiiion niiKbi Im* ex|M’(:leil, ainee one wmh baaed dnooOy 
upon how I'ltRV till* elemeniK wore and the other HoinewlmtleaH diiecUy 
upon their ddhuiliy 'I’ho (orrel'itioiiH iH'tween the varioiiH 1 ih(h of 
wcighta are gi\i‘n in 'J'nble 1 

Ton.!' 1 I'tu »'ca o.'.'frt iir f'Miuo'i.Atio'i iihTWi.i*' W'hoiith ok Kulmbsth is 
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Tlie wriler’a m'coio! hlinly wan aiiniliu oNoepI that inaLead of the 
three random ai-Mignmi'iilH of weighlH, three inHlnniLoiH acUiully 
niiaigned ihem, and (lint, the weighla for CMse and diilieuity weio both 
taken on the aami' basm ao that the conelulion between thorn Avoa 
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tlml oxn-ijt 
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om-i* of iht' 

HrJKhtiriK« nrronlinfj 


to CfiK^ nml ilifliniliy winl of Oik"** !♦> Jlo tfiptmcfor.**, Hit rnrn’lu- 
lionw iK’tv^ci'n wnsjhtH wor?* urnoJirally Ptr<» '1 'Ih‘ho ^ivin liy ihc 
lliw iiiRtnirtorH roro'lnlvl iH**»«m'lv. ni oin* r »’«* liiTuloilly low, mill 
in tlir ollirr I ho only fforly lo^li 

After Hciitliiw loifl ii< trninrn <f j»h *i'’-'nlM*l, tiU'li Hlinknl’n 
h^’<ir<‘ Vin« Ooinjuiftcl uttnrtUu^ *•» ♦ .o'li '’f tio' 'ov phnw of viCinliUnj; 
In iho fir»t «huly Uioo' vo ro oiol^ r i ’o h, nni* liy toiulmg the 

fxiimn hIIkhmI for fill tli»*ol'‘mo»f lo hIm* Ii ln*K‘i\o Oio lorri ct nuMHcru, 
nnil (Ik* other l»y inoftiis «»f tin* HpproM'il fononl'i f'«r mnltinh'-aiiMurr 


ffrore 
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u ho li «ii l)»« r;sH* l»<'r ooo'h hi «.r»- 
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In lliiH, of courw, U MhimIh fe.r tlm ituiMl^f'r of njtiii r>-*i»i»nM ^ uinl \V 
for the iiiiinlwr of HniiiR n*hi«iiiM“<. hi tin* hioioJ jitinl> only nne 
inolluKi, the nuinU'r rorm-l, Him i‘fii|ilo>i*il intonorreliittoiiK 

lietwc'cn tin* won^n on l•:nil of ilm mn Ioimh nrr i^ivon lu 'Inhh* HI 
In llu* hr«l lialf tiicn'of ihn tirri hh’Hm‘i< iiie nro for xi'nrr’^ InimmI ii|mi!i 
corn'd rciijioriHOs only, mol iln* t'ln.iol ft.r M'ori h npnn the 

fonnuln 
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U will Ih> wii tliul unly Jti tlin ciiw* of llir‘ third bfifiLs, timt ih, the 
woighla doliTinincd Hrcorrlnig to ihr nornuil probnhihly curve na 
applied to diflu'ulty, the cwfllcienU between the raw ecorca 
and lliR weighted pron's lower thmi 07, and that in half of the otlier 
coHea in the firnt hludy lln’y are tlfl, and m all tin* othera in both aliKhea 
97 nr 9H Kurtherinnre, aiiionK llir vnnmtH banea of unequal weight¬ 
ing the only ea-«ea in whudi the rfM*flleieiilH dropped nmrkedly below 
.90 \sere tlioFe in w’hieli bnwa two aticl tlmn* worn concerned ^uch 
a rewult wouhl be exjHTled from the fuel that lliere, wiih u fairly high 
negative* corrclalinu Inqurni the weighfa given on tliOKe baaes. Of 
the three Ih-Iwim-h the (lilTm'iit int«(nietorH in the wcond atudy, two 
arc decidedly high, OK tiinl 110, whereas the other one ih eoiiHidcrably 
lower, lieiiig nidy O'J 

Tlie (Miimie*M( Hbnuhl pinlnhly be inwrlefi llml (lie tendency of 
the <orrelatirins and other inese^nreH obtained from the rcHuItH of the 
lirnt Hludy in Hlin>v greater agreeiiieiil than thoFc from the Hocoiid is 
undoulitedly due (<i the fuel timf the (eat eifijilnyed tlierein wan much 
longer than dial u^<'d m lheH*eon(i 

Kidhiw’mg I ’orev'H eMmipIe, the writer alun eoinputed die effect of 
different weights upon inurkK 'rhiH waH done in tin* Hanie way na by 
('orey, eniiHidering (he 7 jmt rent liigheM aenrcH an ..'I’a, the next 24 
per cent an /i'n, f)ie next :tK jmt cent «s r’n, the next 2‘J i>cr cent aa 
D's, and die lou'e.sf 7 fn-r rent ns 7j'n. Table H' given fignren ahowing 
the. pi‘r eeiitH nf the puinls receiving the Haim* buter mark according to 


the variouK numbers nf 

I'ahi.v IV I’laa-i stanch 

basea of weighting 

tty Pavkiih llrerivi.sn Hawk Mahkh Accoumna to 
diyyiati.sr Wmoiitisuh 

Nmiilier of ilifTeri’nl j 

IViccnlAgCH given Haiiie nmrks 

l)n«csi of weiKlituiK 

1'irni nliiilv | 

Kccond atudy 

0 

A‘2, an 

as 

ft 

an. M 

sa 

1 

\2, IK 

1(5 

:t 

It), 11 

14 


. _ _ .. 

. —__ - , —™— - 


Kroin lliiH table it appears dial abouL ‘10 per cent of die nUidonlH would 
have received (be Hiirne letter mark accoiding to all alx liaHoa of weight¬ 
ing, and aliout anothei 3r» pei cent according Lo five of die six In 
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other words, in nhout tlirc^fourtlm of (h** woiiid ptllier nil, or 
all but one, of Iho different tteiRlitiiiKH die muiw' mark 

The perconUfjci) of t» wliirh the uinrks a'^^iKiicd according 
to the dIfFerent bascA except the lital tiifferf'd from if wore also di'icr- 
mined. Tlicse are shown in Table V 


Tajo.kV.—VBKCB hTAiiKfl iwPArBi^insXVjnni S« i jmi'i^nTo Dif^hkht 
WRiaUTlHOrt VaWRO fWiVf TiWjiB PAW.n OS UaW SumJA 



1 IWrerttAg<*ef murks difi'mig fniin meonhng (a 

liwim of weighting 

1 


Kintl fitmly 

pUui> 

') 1 


.11 

3 ! 


ao 


13/^1 i 

H 

fi 

11.10 1 

1 14 

0 

flJK J 

la 


A comparison of the reaiillH obtained in (In' wnirr'a hui cApen" 
mciits witii those of Corey sliows llml iliey indicate mnoli less dis¬ 
crepancy or disMgrocmcnL !>etwmi neores (iNiigited inYonling to 
different baacB of weiRhiing. In vmw of the fart tlint die lestn were 
80 short, one containing only fifty elements and dm odmr only t\\'cnty- 
two, tho roBults are even more* eignifieant. To llm writer they mm 
to offer very strong support of (he conclusion that for new 4 ype Icais 
there is 80 little to be gained by uiieriunlly weigliliiig the eieinents 
that it is not worth tho tal)or of nwiiginng micIi ueigiits iind roinpiitiiig 
scores from thorn. The longer (he (eat the more fully dues llim con- 
cIuBion hold. 




TIIK nANDWniTINf; OK INDIANS 
rnoMAs It (iAinii 
Ilf Ih'uvt-r 

In ohNt l<i ij^rr«'rl?4ni v\ltOhrr or not nn* rarml (ItflcranraH in 
nahvi* lrni(« wi' ‘dinll IriVi* f«» fliow* trailH. \ a '1 na lake llu* 

Himplf’ intifttr of iliffcrautvs ni luiinhvrilinK Ix-Lwaao WIhIch arni 
It in brlonnl ihui iirf jH'culmritie« in hfindwriliiiR 
whicli nin in fniinhi'H in n rum ’rhi* <nif'ilioii in, ilo thpMj pccuhnnlma 
run in rur<'«? D IihIi’Ui iH*culinr to itwlf and (lifTcroiiI 

from Ihiil of AVIntcH? 

Iitiincdiafoly the (irolik'ni Im’coiiM'h a largf (jiip. So riiuny llimgK 
nmd to ho cnnNidorcd 'limn* In (In* qiiPMum <if loKihilify and Hpopd. 
/\not)ii'r iH ibo fim-Hlion of oMln !n* rpialiiy Sidl anollmr in what, liau 
liccn railed i>y Kraplioloiimts "i Imrucloroki^icn)" iitlcrprcliilion YoL 
nnollii'r ih roiiNnlfrafmn of (In* diaKiioxii of (In* liainlNvrduiK of (ho two 
rnci'w. ill do' prcNciil wn ImM* Ih-uii compnlNa! to roiiliiio our 

liirjuiry to (In' |jr«( iim'i*tion, m-, a (‘iiiiipiinMon of the In'gibility and 
of tin’ HiunUvruuur. <»f WIiUvi* and l^ldmn^ 

Piomm.M 

Wo Imsc anki'il oiirHohoi IlmM* <jin‘sinniH; 

1. Do lhi‘j*o full- and imxnd-lilood fiidmiiN wnd* as Iv^ilily as Wlnlo 
childnm <d a liko nclionl Krudn'i* 

!3. I)<i (In-y with Un* Hiiin* npmd'f 

d. WliH'li <jf (Ilf fiM’itirn uiidor coiiMdenUnm liav<* llio Krcator 
innuoncc on l('KilMliiy, as uko, aclmo) Krudo, dc^rrc of White blood? 

t. Wlneli of llu* uliovo faelors has lln* Kreateal inllui’ueo on eperd? 

d. Docs (Ills hiuil^ iiidicutc that (In* Indian nice in luentally 
rcliudcd? 


M vn.uKiA 

Tin* rhorinlikc IliuidwnlinK Senh* was lined in nieasuunK Hiunplea 
of liandwndiii' of \Vlntea and Indiuiut Tim laliiiK was done by 
HludcnlN in elimsi n m ediK.idional ineaMuenmnlH. A Hiunple was often 
rated by ilm niimy im ten mdividualn, and the aveniKO of Iho ratings 
taken as ihe ineuaure 'I'he apeed was delemiincd by dividing the 
total number of letlerfi liy the total time of willing, Because tho 

yod 
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number of cnseB of l\»e NVhOrK w»w W) a'tMAll, wt< bnvr* compollpd 
to resort to tlic use of StHrclin»mrinfl ff»rRnnU’S 


CoMPOsmoN OP TJiK Ciiou PH AN»> mv. U>M KTh OP Mkahuhkme.st 

Tablo I will show tbo rarml ami nlnralntniil romiMKilion of tlio 
groups. There wen* six huiulrcHl thr»N» fuU-bUHxl Indiunfl nnd oncliuij. 
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dred muoty>{tix inix(Ml'blood Imlnuirt fmiiui m ihc I luti'd Siuics Imiiun 
Schools at Chiloccd, (IklaUoiim, uuU Alb««iv)\T<iv\i‘, Kew .Nt<*>»K'(5; 
and there were two liundied sixty Wluio chiUlrpn laken fr«)iii eily tuul 
auburbnn schools of Colorado. Tabic U will show the luudiunK of 
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ftgea and fcon^s for thr ®*vprai graHrti along wah the m«wjr*# of river- 
lapping, whilfi TnMr* III will ehow r*‘rlain rorwlfttintw found l))r‘tw<v©u 
tho varioua fivclonn und^r w>n«id[*»ra!inn, IrKiliiHiy, agr', 

achool gnulo, and df'gn^ of hlor»d 

Only when undprloking In find oortflaiionK liolwccn degTeo of 
blood and ptTfonnanct* wne tho mixpd-hhKKi gfouii rnlnrgfd l»y gmmo 
Whilpa and ftilldilood Indiana {aktm at random 
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Taiii-k IV. A« MiH.TH‘r4, roKnri.ATio.sn yoa MiixKt>-pw>otM, wmi Aob 

D.iyiKAiai> 

1. tfrorf' I^Kdtiltly (U. kwI*' (ii). ilparr»» (!) 

fU-I) ' %\ Tmiir ’I'uji’i I 6u *11 

ei [}Kzy 1 0,'ir»Tt 

Wf-lght (if gra-l'* W Wnuhliif dcgoHMif wltini hUwiil r. fllH 

II JVno'fl), grnd'’('.Ji, (^'Krr^’(0 « V’O 

Ji ’-i (f/u I*} J hu ♦?( rj ' - .lir(7xi 

Wrighl of Hi'hi) goidr ^ IIW. Wt'iglit of drgrci* of Wlnlo hliioil ^ -.057. 

LNTKMlUIhrATION 

U will Ih' ac'on upon ('xniniimlion of Table tl ibnl the IiulianK, 
botli full- and inixed-blooda, an* miioh older limn llui \Viii(ea. Kur a 
school grade Om agcrt of Hu* full-bliMuls run on llio average llirco years, 
and Iho mixed-bloods run four years older limn Ibo WhUes. The 
range of agi* for full-bhmdH is from len to twenty-lbree years, for 
mixed-bloods is from leti to fwenly-Uiree, and for (lie WluleB ih from 
eight lo hfteen Ibmever, Ilia median Hcoies of legibility for tlie 
raeial groups ar<' just abniil llie huhu*, i.r, full-bloodH, 1)2; mixed- 
blonds, K.S; and Whiles O.I. On the other hand Llie speed of tin* 
fuJi-bloods is greater timn thiil of oilher the mixeil-idoods or tho 
Whites. In turn (be speed of Iho mixed-bloods is greater than that 
of the Wliltea tlieso median scores for spend aro respectively 00.9, 
67.9, and .■>0.2 letters per minute. The reader must not conclude 
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(linl the (hffcirnw' >r» m Uik- spiN'ur^ on llic Hurface. 

This will bn diwifwi loU-r on 

It wiM Irfs l«‘tlnr to nSHiniwo TnM‘ 11 Inr o roio|u<riM»n of legibility 
frcorew anil ojK'^’il wirtf* by groden for On* r.icod grtnijif It will Ix' 
seen lien* ibnl iM*rfi<rio»nr'K f«f lli«‘ oii' I'li llie \\holi3 more 

oonrly bke llu* WlnSi' nonim from Mineli, iu** )h il by llie u\er- 

la]ipi»g) iluAU ari' «f llw' Hov,i'Vrr, ibey 

apiK'ar as talber mfenur in \» fConimnc«* lo HlnrobV tionoF, 'I’liay att* 
more nearly liko our im'iUaiih for WIiH^ i» 'I'loii m to t*ay our Whites 
fluffer m companwui sviili ihr StJireh n^rltJ^ If rrie*'’ nifult* a tlinference, 
the inixed-blrHitlw might Ut ehow tip W'lfer U|Min rfunjuiriwoi limn the 
full-bloodfl, inu i!ii*y il« not Tin* kiiiio is true for hihoiI The full- 
blood perfornmneeH nn* iiinre neiirlj liko tho .^Inreli noriim for eiKtctl 
than are the rnixf'd'bloods uh pjilgn) Ii_v the overhipping 

If the reader uill r« for to T«>d<H HI and U', he \m 11 eee llml Iho 
grealnt correlation m fomnl for »U |trn\)}>a l>i‘fiuen legibiluy nnd 
swhool grade, and »^[veed aiid arUtad grade v,ttU exeeptmim found m the 
Wlulft data Age u* a 1 ^‘rmdl farpir exet pting lu th** eaee of the Whiles 
where it 18 found to U' HiKriihenntly (NtrrT*lnt4'd v.ilh i^iWH'd (.-M) and 
alightly with legibilily f liKI For Whilen ihere im the uwuol IiikIi eorre- 
Intion bolwnen agnniidRradft 112). Oirealiouhl not me the iimignificnnl 
corrolatioii coeflieieiilH for degree of MihhI mid f,i'giluliiy mid SiM-ed 
They are rcHpeclively orhlaiul nrd. Multiple roe(hei«’Hi‘'of eorrola- 
Uon (Table IV) wen* found Indweeii legibility and Kidiool grade and 
degree, and ap(*e<l, kcIioo) grade and degree for ilu' iui\eil-ldood group. 
TKeHo nn‘renpeetively uiid 2l» H'lu an* noi mt.v Ingb 'They 
were caleiduled for the purjK»«i* of detenuniing the ssiughl llml should 
bo luyugnetl respectively l«i whuol grade and degrta* of While blund 
Foi I/Cgibilily it will beHS'H jIuilI llu* rulm for •‘chttul grade and ilegree 
iB Ion to one, and for hpeed, about hix to one with (lu one a nunuh 
quiintUy. Il will he M*c*n that degree of blood m a iiialU'i of miuiH 
eignificancc. Klaowhere it Inm Imen 8lio\vn that im<lead of degree of 
blood having (he weight, il Mriim to lane (he Mtua(ion may IH)^.*^lhl,^ 
be duo to the influence of voeial alaliiH going wulh the degree of Moud 
At any rate degree in of extiH'iiiely Miinll weigiii 

SUMUAHY 

What, then, doon (hm atudy aluiw? 

1. The full-bloods are on (he wliolu wunewhat Im tier in legibility 
than tho mixed-bloods, niid (he Whitea an* Im’hI of all. 
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2. Tlir IruliunH am «() luon* iior Ichh JiiHvdy lliau oxcopling 

in thp KiRlUli tirudo wimn' tlm WhiU*H I'xrci. 

'A, Tiio RmiiU'Ht fncl(»r iii inliuf'ncuig Hrom in logtluhly nnd upccd 
for iho IndiiitiH 1*1 Hrhuol nmdi* Age liiia lii lit* HiRiiihcant-c, and doprrcc 
of WliiU* blwid pnmtirally nfi mRiiiliriiiin* if any. 

4. TliiHflludy dfU’n nnt indteaU* lhal IndiunKura iiiriitally retarded 
at len^t lui tins la ^)Jo^v^ in reajH'ct (n ability in huiulwnting. It ia 
aceii that with jiroiaT traiinnR ImliaiiH niny roinparc well with Wliitca 
m hnndwnling 



A MEAvSUREMKKT OF THF KNOWJJvDGK OF 

PHvrnoLooY rkfouk a.\i> aftkii 

FOU^fAi, TUA1NIN(J 

t‘At,VIS lUlJ. 

Tho puriHv**!' nf iluH lo 

fintl; 0) Thf umtuml t*( on a f^impm^hc nHut* iihj(>cLive 

oxammfklion in plt*mrnt«ry |v^j anil h/Ict Inking a 

cflunw^ Jft tlinl wihipci; VM Oif niiiPin tin* Kcnm^i on ilic 

first nml w'coiul Inking of |U<' UM: t.'ii ili*'tvlMion Ix-ivm'n first and 
wiocind Uking of tKc (<»rI nmt Uo' Hwnt* on a colkgo nplUmir* (*1) 
Iht* rriflllon iK'tiwn gunw i1k»i t'’, sror** i-n ilir- oxnininntion 
minus Ktsorr on iho fim rtmniiialion nml ndJrgf npJihnlr' corin’; nnd 
(5) thn offset of iminiog on UM rrhalniity 

The first ami last 0 ’<flmiimUonM won- nlouiir'il mn) uojo giVMi on the 
inUial and final of On* ’IJn* > \(miinM!>i>n ron^Htf'd jjf 

onti Imnclrerl righteon inio*f»F*’ iU'in» l.a-ri! njmii I'trnn mid Kli'in'a 
"Psycliology" the rlmd WafUnik n^d Ttw WiiHlungiou College 
ApUtu<lc t<Kt vvns Riven as u imaHim* of eolh g** npiiludf. 'f‘lns U-st m 
mndn up of tlio ummiiI "itilejligeinV* te^l Tin* Mihji cN urn* nil 

momlM'ra of a rlasu in Vayehofogy 1,1 ni tin* rmvrrMty of (Inlifornlii 
clurlng the s\nnnu*r of Ul.ltl 'I I»k eour-o o\i»'nd*< over n jSTiod of si\ 
weeka. 

The data nn* proH'iiled m ’lalden I nnd U, 

TaWI-R I ■ o>» >^O.W \Ktuiojis l>V 

•Siaw^w, Ah'j* (^ti r»'H’»'sr-. tn* 


Vttriftiilp 

i N' 

] 

1 

: 

1 

sn.,f , 

r.H'tlii’ii'iil nf 
Vfinuttim 

College njilUodc 

1 m 

1 U1 Oi 

' ‘JS 1 



thirst oxflTninnlion 

' 01 

, vu w 

: A w’.s 

- 'PJS 

S I1S7 

r^fisl exauuiialmti 

i 

U J 7« 

« M'«N , 

• .'VlKV j 

V m 


Tho lack of nrm*KllgihU» corrclalkuiH indiealo llml liillo rnlatiitiiHlnp 
oxifits between llio variablea wc wiw inveatigaiing. (‘oiiHideruiK the 
corrected coefTicfeota alone, however, wrtuin (rends are noticeiihlo. 
Thua, whutover is measured t»y itie WnHhiiiKtoii tJolIeKo Aptitutlo t(‘st 
has more in common with the firal preacnlalion of the p-sycliolony 

no 
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oxnminfttlon (l>an w»lh ThwwlolK'pxpc^clwl. '‘InU-lliRMieo" 

should lx* a muro imjwirinHt clftlftrmmnnf of information iKtforn than 
aftor f(jrmal iralmriK iK’cnuxft olhpr fnclora cntor into Ihr final examina¬ 
tion, f.g.i inton^l, ronn'iilratum, hnliitNiof Rliuly, to liwri (lir* ofTfoLof 
''uitftlliRonw.*' Tim lark of corrolaUnn l>rtw(H'n “nauiH” and oollrKo 
aptitudr aroro can In' int^'rprcM in Iwii wap. Kilhfr iniprovcrncnt 
in thiH »|H*cilio coiimn la not da|K'ndriil ujkui any of Iho faclora that 
dolcrmma "mU’lliRcncr'' l<‘Rt neon* or Clm law of diminiahing rolurnK 
may oiK'rato lo cnaldc llmw* doing |Joofly on (hn firwt taking of the 

TaOLF, n f^OMMAUT OF iNtXianKrTKII ANP (JoHHBCrKD OoaRKr.ATlOW Ck)RFrt- 
ciKNTa ANP ItBLiMiniTr CMurricm'iTa wmi riwnuiii.r. Kaaoiut (Uncom- 

HFOrBO rA JJV ri,M> PHIHf, (NiHliM’rl.O DY UHDHRaCOWIKO ANP 
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oxamnmhon (o muko groalor gaiiH than tlimr inon' mfornii'd cIuhh- 
nial(‘H 'L'lio iir.ll aiid Iasi tukiiig of (ho oxaininiUmn conrlalo juHt 
inodcniU'ly 1ml proliahly ii« w«*ll as any Iau) cour^o oxammiilioim 
(Viiiiinly tlio h(‘on' on our OMUiiinutioii lioforo fonnal training o.minot 
bo iihcd to prc(l)i-t anno will ho iiiuilo on (lio huino (‘xarninaiion 
after framing 

'I'lii* objeoMon may be nuFCil llml wo ilid nut vahdaU- oiir exaiiiinu- 
lion. Tina obji'etion dues not vilally affect our resultH, how(*V(’r We 
assmncil ilmt wo were ineamiiing kiH»wledgo of pHyeluilogy when wo 
aeleeied (pie.sliouH fioia I ho (exlhuok jiiHlaneveiy lUhi motor does when 
be eonHlruelH an aclneveinent lest for giaduig pin poses, 

k'nillier eoneluHioiiH that Ktiould be noted are Iho following 
1. Altbdugli the iib«olule varlalnlity on tli(‘ last e\ainination 
nicreaaed over that of the, fnal, the dilTerence liotwoon the Htandard 
deviutioiiH m not «iginficant. The relative vaiiuliihly as inoaHiued by 
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^ ht* last 
‘‘^Hrnmn- 


tlip c^K-ninrnl of ^jtj<it}rkii ni. .i» .I- 

fMWTiinndnn «,« uinHy-iH,,,« r r, ‘r^yir'n ''■“'I''’"'^' 

Ti™ ti,(r™,^ ';■ .. 

2. The t. lml,ilii.v rwffir,,,,! „f ,(„. | ,»i ., 
ni«rk«llj- „rn (hat t,f il,.. fip>, "'m.n«.d 

may crirarlhu.. ,h.. Z.:!, 

ufolrtni’iil tif II rclmlnhiv t^x'llii'iuii f. r ' ""'Hl. Hcnw any 
pawcill.y n.if*wn|iliMn',.Jrl,..Mi|.,,.r-’» '" "'™m- 

of ™iu!I, 
unknown n>l,nl„li(v. diioh u-Z nr,-. , ''' l*"«w« n low or 

for MlooiinK MniirnilK wIlt.. iI,.. rlra< T ‘'''''‘Cos 

bn«n of hill (Ini,, con.lr.n.nH t|„n p, '' on (hr 




